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INTRODUCTION 

The  Health  Care  Financing  Administration  (HCFA)  was  established  in  1977 
to  combine  health  financing  and  quality  assurance  programs  in  a  single 
agency.  Within  the  Department  of  Health  and  Human  Services  (HHS),  HCFA 
is  the  principal  source  of  funding  for  long-term  care  services.  The  vast 
majority  of  these  funds  are  used  to  pay  for  nursing  home  care  in  both 
skilled  nursing  facilities  (SNFs)  and  intermediate  care  facilities 
(ICFs).  Along  with  its  financial  role  in  the  delivery  of  long-term  care 
services,  HCFA  is  also  responsible  for  assuring  the  quality  of  these 
services  by  setting  standards  for  care  providers  and,  in  conjunction  with 
the  States,  enforcing  those  standards. 

This  report  introduces  a  new  process  to  be  used  by  Federal  and  State 
nursing  home  surveyors  in  enforcing  the  regulatory  standards.  The  new 
long-term  care  survey  process  is  the  result  of  years  of  Federal  and  State 
experimentation  with  alternative  survey  methodologies.  It  implements  a 
major  change  in  the  traditional  nursing  home  survey,  a  change  that  has 
been  advocated  by  providers,  consumers  and  surveyors  themselves,  i.e., 
the  focusing  of  inspections  on  direct  resident  care  and  the  outcomes  of 
that  care  rather  than  on  the  structural  elements  underlying  the  care. 
Although  the  new  survey  process  represents  an  advance  over  the 
traditional  process,  HCFA  recognizes  that  further  improvements  to  the  new 
process  are  still  desirable.  HCFA  is  committed  to  a  continuing  dialogue 
with  the  other  primary  parties  involved  in  the  nursing  home  quality 
assurance  system  in  order  to  both  refine  the  new  survey  process  and  to 
more  effectively  coordinate  the  process  with  other  aspects  of  the  overall 
system. 

The  purpose  of  this  report  is  to  describe  how  the  new  long-term  care 
survey  process  became  a  reality  and  what  it  is  intended  to  accomplish. 
The  report  begins  with  an  overview  of  the  Federal  quality  assurance  role 
and  the  circumstances  that  led  to  a  new  survey  process.  Chapter  Two 
details  the  experimental  State  systems  approved  by  HCFA  to  test  new  ways 
of  surveying  nursing  homes.  Chapters  Three  through  Five  cover  the  early 
development  and  testing  of  the  new  survey  process  and  the  extended 
evaluation  and  refinement  efforts  of  1985,  followed  in  Chapter  Six  by  a 
specific  discussion  of  the  new  survey  procedures  and  forms.  The  report 
concludes  by  describing  the  role  of  consumer  advocates,  the  nursing  home 
industry  and  the  State  survey  agencies  1n  developing  the  new  process 
(Chapter  Seven),  looking  at  the  new  surveyor  training  program  (Chapter 
Eight),  and  providing  some  insight  into  HCFA's  plans  for  the  ongoing 
evolution  of  the  survey  process  (Chapter  Nine). 
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CHAPTER  ONE 
BACKGROUND:   THE  FEDERAL  QUALITY  ASSURANCE  ROLE 

Although  the  Federal  government  has  been  involved  in  the  development  of 
quality  standards  for  nursing  home  care  since  the  late  1950' s,  the  passage  of 
Medicare  and  Medicaid  in  the  Social  Security  Act  Amendments  of  1965  signaled 
the  beginning  of  an  active  Federal  enforcement  role.  With  the  enactment  of 
Medicare  and  Medicaid,  the  Federal  government  moved  from  advisor  to  primary 
participant  in  the  development  and  enforcement  of  nursing  home  care 
standards.  Despite  this  increased  Federal  involvement,  the  nursing  home 
inspection  process  has  historically  been  viewed  as  a  "haphazard,  fragmented 
and  generally  inadequate"  one.  1/  This  section  of  the  report  presents  a  brief 
overview  of  the  current  inspection  process,  discusses  some  of  its  perceived 
problems  and  provides  background  on  the  events  that  fostered  development  of  a 
revised  survey  process. 

Description  of  the  Federal  Quality  Assurance  Process 

Sections  1101,  1863  and  1905(c)  of  the  Social  Security  Act  authorize  the 
Secretary  of  HHS  to  prescribe  regulations  that  must  be  met  for  a  facility  to 
become  a  provider  under  the  Medicare/Medicaid  programs.  Since  1966,  nursing 
homes  that  provide  care  for  Medicare/Medicaid  beneficiaries  have  been  required 
to  meet  Federal  regulations  for  the  health  and  safety  of  these  residents. 
These  regulations  (42  CFR  Part  405,  Subpart  K  and  42  CFR  Part  442,  Subpart  F) 
are  enforced  through  an  annual  certification  survey  of  each  nursing  home  by 
the  State  survey  agencies  under  contract  with  HHS.  As  amended  in  1967,  the 
Social  Security  Act  (Sections  1902  (a)(26)  and  (3D)  also  requires  States  to 
perform  an  annual  review  of  each  Medicaid  recipient  in  a  long-term  care 
facility  to  determine  the  appropriateness  of  the  level  of  placement  and  the 
quality  of  the  recipient's  care  and  services.  Regulatory  requirements  for 
this  inspection  of  care  (IoC)  process  are  contained  in  42  CFR  Part  456, 
Subpart  I.  The  two-pronged  Federal  process  is  supplemented  by  nursing  home 
licensure  requirements  established  and  enforced  on  a  individual  State  basis. 

The  Survey  Process 

The  facility  survey  process  is  the  means  for  determining  whether  nursing  homes 
are  compliance  with  Federal  regulations  and  can  be  certified  for  participation 
in  the  Medicare  and  Medicaid  programs.  It  consists  of  an  annual  on-site 
inspection  by  a  team  of  State  surveyors  to  assess  compliance  with  applicable 
Federal  regulations.  Following  each  survey,  the  State  Agency  survey  team 
provides  the  facility  with  a  list  of  deficiencies  that  must  be  corrected  in 
order  to  obtain  or  maintain  certification.  The  nursing  home  must  then  develop 
an  acceptable  plan  and  timetable  for  the  correction  of  all  deficiency 
citations.  In  most  cases,  State  surveyors  then  conduct  follow-up  visits  to 
assure  that  corrective  action  1s  taken.  A  home  that  continues  to  fall  to 
comply  with  Federal  requirements  is  subject  to  decertification.  This  means 
that  It  can  no  longer  receive  Federal  reimbursement  for  Medicare/Medicaid 
residents,  although  1t  may  still  serve  private  patients  If  State  licensure  is 
retained. 
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Although  the  State  survey  agencies  conduct  the  certification  surveys,  HHS 
maintains  oversight  by  performing  independent  Federal  surveys  of  facilities 
recently  inspected  by  the  States  and  comparing  results,  as  well  as  through 
annual  field  visits  to  examine  State  agency  program  management  procedures. 
HHS  has  also  developed  the  Medicare/Medicaid  Automated  Certification  System 
(MMACS),  which  provides  a  ready  data  base  on  the  individual  and  aggregate 
nursing  home  survey  results  from  all  the  States.  Finally,  HHS  provides  the 
States  with  standardized  survey  forms  and  procedural  guidelines  to  be  used  by 
all  State  surveyors  in  determining  compliance  with  Federal  requirements.  The 
changes  in  this  component  of  the  survey  and  certification  system  are  detailed 
in  Chapter  Six. 

The  IoC  Process 

As  noted,  the  IoC  review  process  is  composed  of  two  major  functions:  quality 
of  care  review  and  level  of  care  review.  Quality  of  care  review  is  concerned 
with  the  appropriateness  of  care  provided  to  meet  the  health  needs  of  each 
Medicaid  recipient.  Level  of  care  review  determines  the  necessity  and 
desirability  of  an  individual's  continued  placement  in  the  facility  and  the 
feasibility  of  meeting  his  or  her  health  care  needs  through  alternative 
institutional  or  noninstitutional  settings.  HHS  has  provided  some  guidance  to 
State  Medicaid  Agencies  for  performing  IoC  reviews,  but  it  has  been  much  more 
limited  than  assistance  under  the  survey  program.  Annual  inspections  must  be 
conducted  by  review  teams  composed  of  physicians  or  RNs  and  other  appropriate 
personnel,  and  the  reviewers  must  have  personal  contact  with  each  recipient 
and  review  each  recipient's  record.  Federal  oversight  of  IoC  review  is 
limited  to  assuring  that  States  meet  procedural  requirements,  with  no 
concerted  Federal  monitoring  of  the  effectiveness  and  efficiency  of  the 
individual  State  programs  and  no  Federal  enforcement  role. 

An  idea  that  has  generated  a  great  deal  of  interest  over  the  last  few  years  is 
that  of  integrating  the  IoC  review  process  with  survey  and  certification 
reviews.  Fifteen  States  now  have  integrated  systems,  which  can  be  roughly 
defined  as  the  use  of  one  team  to  conduct  a  facility  survey  and  an  IoC  review 
on  the  same  visit  and  linking  the  findings.  Both  certification  surveys  and 
IoC  reviews  have  the  same  overall  purpose  of  insuring  that  appropriate  care 
and  services  are  provided  to  nursing  home  residents.  Since  the  new  survey 
process  greatly  emphasizes  the  review  of  individual  resident  care,  thus 
increasing  duplication  between  the  two  review  programs,  the  issue  of 
integration  is  likely  to  take  on  greater  importance. 

Problems  with  the  Survey  Process 

During  the  advent  of  Federal  long-term  care  standards  and  the  accompanying 
quality  assurance  programs  in  the  late  1960's,  the  prevailing  school  of 
thought  was  that  health  and  safety  standards  should  provide  the  framework  for 
appropriate  care  to  take  place  and  that  quality  care  would  inevitably  result. 
Under  this  approach,  regulators  were  expected  to  measure  compliance  and  base 
enforcement  on  a  facility's  "capacity"  to  provide  acceptable  care.  As  the 
Department  of  Health,  Education  and  Welfare  (DHEW)  noted  1n  a  report  to  the 
Senate  Special  Committee  on  Aging,  "Present  regulations  for  survey  and 
certification  procedures  only  confirm  whether  or  not  the  facility  1s  capable 
of  delivering  the  required  services,  not  whether  the  facility  has  implemented 
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them  or  whether  quaTity  care  has  actually  been  administered."  2/  In  theory 
then,  the  survey  process  would  focus  on  a  facility's  capacity  to  deliver  good 
care  while  the  IoC  review  would  focus  on  the  appropriateness  and  quality  of 
care  actually  delivered.  Not  surprisingly,  criticism  of  this  system  surfaced 
swiftly. 

As  early  as  1970,  the  Senate  Special  Committee  on  Aging's  Long-Term  Care 
Subcommittee  heard  testimony  that  "...  inspectors  are  more  concerned  with 
the  physical  plant  and  less  with  the  quality  of  patient  care",  3/  and 
variations  of  this  criticism  have  continued  unabated  since  that  time.  Another 
common  criticism  has  been  that  the  traditional  survey  process  is  overly 
reliant  on  written  documentation,  resulting  in  the  proliferation  of  what  has 
come  to  be  known  as  "paper  compliance".  New  York  State's  Morel  and  Act 
Commission  summarized  this  problem  in  its  landmark  1975  report  on  the 
regulation  of  nursing  home  care: 

"A  'deficiency'  rating  caused  by  the  absence  of  such  written  material  as 
general  patient  care,  nursing,  dietary  or  special  rehabilitative  plans  or 
by  the  absence  of  written  pharmaceutical  procedures,  while  relatively  easy 
for  a  surveyor  to  render  and  verify,  in  most  instances  is  difficult  to 
consider  significant  enough  to  merit  imposition  of  meaningful  penalties. 
Nonetheless,  surveyors  apparently  devote  a  substantial  portion  of  their 
time  noting  such  deficiencies  and  demanding  corrective  action.  And,  of 
course,  a  'paper'  deficiency  can  be  corrected  with  relative  ease  by 
'paper'  compl iance."  4/ 

The  report  went  on  to  note  that  fully  290  of  526  identified  items  on  a  SNF 
survey  report  form  could  be  answered  by  a  surveyor  exclusively  with  reference 
to  a  facility's  written  plans,  policies  and  records  while  only  30  items  would 
require  direct  observation  of  patients.  5/  Moreover,  the  Commission  presented 
statistical  analyses  indicating  that  there  was  no  correlation  between  the 
overall  results  of  surveys,  concentrating  supposedly  on  whether  nursing  homes 
had  the  "capacity"  to  render  quality  care,  and  the  results  of  IoC  reviews  that 
were  to  directly  assess  patient  care.  6/ 

The  Federal  government  did  take  steps  during  the  early  1970' s  to  upgrade 
nursing  home  care,  including  the  establishment  of  a  Federal  training  program 
for  State  nursing  home  surveyors  1n  1971  and  the  creation  in  1972  of  the 
Office  of  Nursing  Home  Affairs  to  consolidate  all  Federal  nursing  home 
enforcement  responsibi 1 ites.  Also,  in  1974,  DHEW  published  new  regulations 
that  implemented  unified  performance  standards  for  SNFs  and  ICFs.  However, 
these  changes  did  not  succeed  1n  ameliorating  continuing  widespread  concerns 
over  the  reliability  and  validity  of  the  nursing  home  survey  process,  a 
process  that  has  undergone  little  substantive  revision  since  its  Initiation. 

The  Search  for  a  New  Survey  Process 

Since  1977,  both  the  newly  formed  Health  Care  Financing  Administration  (HCFA) 
and  some  of  the  Individual  State  agencies  responsible  for  inspecting  nursing 
homes  have  been  experimenting  with  different  methods  of  assessing  quality  of 
care  through  modifications  to  the  survey  process.  The  specific  concerns  about 
the  traditional  survey  that  prompted  the  search  for  a  modified  long-term  care 
survey  process  Included: 
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Undue  emphasis  on  the  structural  and  procedural  characteristics  of  a 
facility; 

Failure  to  evaluate  facility  performance  1n  terms  of  the  actual 
delivery  of  services  and  the  measurable  effects  of  care  on  patient 
outcomes;  and 

Inconsistency  in  surveyor  findings  due  to  varying  State  methodologies 
in  conducting  surveys  as  well  as  widely  divergent  individual  surveyor 
interpretation  of  program  requirements. 

HCFA  and  the  States  agreed  on  the  need  for  a  survey  process  that  could  more 
directly  relate  certification  decisions  to  the  quality  of  care  provided  to 
individual  nursing  home  residents.  Beginning  with  the  Wisconsin  demonstration 
project  in  1978,  HCFA  authorized  a  series  of  State  demonstrations  and 
experiments  incorporating  various  modifications  to  the  traditional  survey 
process.  Chapter  Two  of  this  report  provides  details  on  the  objectives  and 
methodology  of  each  State's  process.  One  shared  element  of  all  the 
demonstrations,  however,  was  that  the  modified  survey  processes  generally 
focused  on  the  review  of  resident  care  while  decreasing  emphasis  on  the  review 
of  administrative  policies  and  procedures.  It  has  been  demonstrated  in  many 
instances  that  positive  survey  findings  resulting  from  a  structurally  based 
process  are  not  always  an  accurate  indicator  of  high  quality  care  in  a  nursing 
home.  Conversely,  negative  findings  from  a  structurally-based  process  do  not 
necessarily  indicate  that  a  nursing  home  is  providing  low  quality  care.  This 
lack  of  a  direct  relationship  between  structural  capability  and  actual  quality 
of  care  tended  to  undermine  the  credibility  of  the  total  survey  process. 

By  early  1983,  preliminary  results  of  the  State  demonstrations  and  experiments 
were  providing  evidence  of  the  availability  of  viable  alternatives  to  the 
traditional  process.  HCFA  began  development  of  a  modified  survey  process  that 
synthesized  the  best  components  of  the  State  approaches  while  maintaining 
national  applicability.  The  primary  objectives  in  developing  the  new  process 
were  twofold: 

To  increase  reliability  by  providing  a  survey  process  and  reporting 
form  that  would  ensure  greater  uniformity  in  terms  of  review 
approach,  documentation,  and  certification  decisions;  and 

To  increase  the  val idity  of  the  survey  process  by  emphasizing 
surveyor  review  of  outcomes  and  provision  of  care  rather  than  paper 
and  structural  review,  thereby  allowing  more  time  for  direct  patient 
observations  and  interviews. 

The  result  of  this  effort  was  the  Patient  Care  and  Services  (PaCS)  survey 
process,  the  direct  forerunner  of  the  process  that  1s  being  Implemented 
nationally  in  1986. 

Consensus  for  Change 

As  HCFA  was  1n  the  process  of  reevaluating  the  traditional  survey  and 
certification  system,  other  segments  of  the  long-term  care  community  began  to 
play  expanded  role.  Although  there  had  long  been  a  consensus  among  Congress, 
Federal  and  State  agencies,  consumer  organizations  and  the  nursing  home 
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industry  that  changes  were  needed  in  the  survey  process,  there  was  not  always 
agreement  as  to  the  nature  of  these  changes.  In  May  of  1982,  for  example, 
HCFA  issued  a  proposed  set  of  changes  to  its  regulations  governing  survey  and 
certification  standards  and  procedures  (42  CFR  Part  405,  Subpart  S).  These 
regulations  had  been  in  effect  since  1970  with  no  substantive  changes  since 
1973.  Proposed  changes  in  the  regulations  included  such  controversial  items 
as  reducing  the  required  frequency  of  surveys  and  expanding  the  use  of 
national  accreditation  organizations  for  facility  certification  purposes. 

Release  of  the  so-called  Subpart  S  proposals  elicited  a  very  strong  and 
largely  negative  response.  Congress  reacted  by  placing  a  six-month  moratorium 
on  any  changes  to  the  current  nursing  home  regulations  beginning  in  November, 

1982,  and  eventually  extended  until  August,  1983.  Then,  in  April,  1983,  the 
Nursing  Home  Standards  Act  of  1983  (P.L.  97-276)  was  introduced  in  Congress. 
The  bill  proposed  to  set  up  a  National  Commission  on  the  Regulation  of  Nursing 
Homes  under  the  National  Academy  of  Sciences,  which  would  conduct  a  study  of 
the  nursing  home  regulations  and  make  recommendations  for  needed  changes. 
During  the  study  period,  the  bill  would  have  required  that  the  moratorium 
remain  in  effect  on  changes  in  the  Subpart  S  regulations  and  the  related 
conditions  of  participation. 

Although  the  bill  was  not  passed,  HCFA  agreed  to  sponsor  a  comprehensive  study 
of  the  regulation  of  nursing  homes  by  the  Institute  of  Medicine  (IoM)  of  the 
National  Academy  of  Sciences.  In  conjunction  with  the  IoM  study,  which  was  to 
focus  on  "basic  issues  and  long-term  policy  alternatives,"  HCFA  also  agreed  to 
consult  with  consumer  advocacy  groups,  State  survey  agencies,  and  the  nursing 
home  industry  to  identify  possible  short-term  measures  to  improve  the  nursing 
home  survey  and  certification  process.  From  May  through  December  of  1983, 
HCFA  organized  a  series  of  meetings  with  a  workgroup  composed  of  Federal, 
State,  consumer  and  industry  representatives  in  order  to  identify  areas  of 
consensus  on  such  measures.  These  sessions  came  to  be  known  as  the  Subpart  S 
meetings . 

The  possibility  of  a  modified  nursing  home  survey  process  was  not  part  of  the 
original  agenda  for  the  Subpart  S  meetings  but  soon  surfaced  as  an  adjunct  to 
discussions  on  extended  survey  cycles.  On  June  14,  1983,  the  six  States  that 
had  implemented  innovative  survey  approaches  presented  reports  to  the 
workgroup  on  their  progress  and  available  findings.  During  subsequent 
sessions,  HCFA  staff  reported  on  its  progress  towards  development  of  a  new 
national  survey  process. 

The  last  formal  meeting  of  the  Subpart  S  workgroup  took  place  on  December  13, 

1983.  By  this  meeting,  a  consensus  had  been  identified  among  the  divergent 
groups  reconfirming  the  belief  that  the  survey  and  certification  process  would 
be  substantially  improved  if  it  focused  on  the  actual  quality  and  provision  of 
resident  care  rather  than  on  a  facility's  structural  and  procedural  capability 
to  provide  quality  care.  All  parties  agreed  that  the  observation  and 
assessment  of  residents  should  be  the  primary  basis  for  compliance  decisions. 
The  participating  organizations  expressed  their  unanimous  support  for  the 
reforms  embodied  in  the  early  version  of  the  PaCS  survey  process  and  for  the 
eventual  Implementation  of  a  resident-based,  outcome-oriented  survey  process 
on  a  national  basis.  With  their  support,  HCFA  began  the  extensive  process  of 
testing  and  refining  PaCS,  which  has  culminated  1n  a  new  national  nursing  home 
survey  process. 
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CHAPTER  TWO 
STATE  DEMONSTRATIONS  AND  EXPERIMENTS 


Introduction 

An  integral  aspect  of  our  effort  to  develop  an  improved  nursing  home 
survey  process  was  the  Federally-approved  State  testing  of  innovative 
survey  methodologies.  Beginning  with  Wisconsin  in  1978,  six  States 
developed  and  implemented  modified  survey  forms  and  review  processes  that 
they  felt  could  provide  better  measures  of  nursing  home  performance  than 
the  traditional  survey.  The  State  approaches  shared  the  common  objective 
of  concentrating  on  the  review  of  resident  care  and  outcomes  while 
eliminating  unnecessary  paper  review.  When  the  actual  care  was  deemed 
satisfactory,  most  of  the  States  considered  it  unnecessary  to  look  in 
detail  at  the  structure  underlying  the  care  process. 

The  State  survey  projects  took  two  different  forms,  demonstrations  and 
experiments.  Alternative  State  survey  demonstrations  often  involved  the 
waiver  of  regulatory  requirements  and  were  authorized  by  HCFA's  Office  of 
Research  and  Demonstrations  (ORD)  for  Wisconsin,  Massachusetts  and  New 
York.  The  State  experiments  consisted  of  changes  in  the  survey  process 
within  current  regulations  and  were  approved  by  HCFA's  Health  Standards 
and  Quality  Bureau  (HSQB)  for  California,  Washington  and  Iowa.  Rhode 
Island  was  also  approved  to  develop  an  experimental  survey  approach, 
which  was  eventually  synthesized  with  the  PaCS  process  prior  to 
implementation  by  the  State. 

Most  of  the  new  survey  approaches  HCFA  examined  used  forms  with  specific 
performance  indicators  directed  at  the  care  actual ly  provided  by  a 
facility  rather  than  the  facility's  capabi 11 ty  to  provide  care.  This 
same  approach  has  been  incorporated  as  the  cornerstone  of  the  new 
national  survey  process.  In  developing  the  new  survey  form,  HCFA  staff 
reviewed  and  categorized  the  patient  care  indicators  used  by  the 
experimental  States  and  then  synthesized  the  appropiate  indicators  for 
national  application.  The  individual  State  models  governing  the  use  of 
these  indicators  were  also  carefully  reviewed  prior  to  the  initial 
development  of  a  national  model.  Although  the  diversity  of  States  in 
terms  of  sophistication,  resources,  and  survey  structure  precluded 
adopting  any  of  the  experimental  protocols  on  a  national  basis,  selected 
elements  of  the  State  models  were  built  into  the  new  national  survey 
process. 

The  rest  of  this  section  provides  a  brief  overview  of  the  objectives, 
approach  and  results  of  each  of  the  approved  demonstrations  and 
experiments.  Most  of  this  information  was  drawn  from  the  final 
evaluation  reports  submitted  to  HCFA  on  each  of  the  individual  State 
demonstrations  and  experiments.  (Copies  of  these  evaluations  are 
available  under  the  Freedom  of  Information  Act  upon  request  to  the  U.S. 
Department  of  Commerce,  National  Technical  Information  Service, 
Springfield,  Virginia  .22161 .) 
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Wisconsin 

Beginning  in  July  1978,  and  continuing  until  July  1982,  ORD  granted 
Wisconsin  a  waiver  to  demonstrate  new  methods  for  conducting  nursing  home 
surveys  and  IoC  reviews.  Under  Wisconsin's  Quality  Assurance  Project 
(QAP),  facilities  with  a  history  of  good  compliance  were  eligible  to 
receive  screening  surveys  and  IoC  reviews  of  a  sample  of  Medicaid 
recipients  rather  than  the  traditional  100  percent  resident  review.  The 
primary  objective  of  the  demonstration  was  to  increase  the  effectiveness 
of  the  facility  survey  and  the  resident  IoC  through  the  reallocation  of 
existing  resources.  Wisconsin  anticipated  that  the  screening  and 
sampling  approach  would  allow  surveyors  to  use  their  time  more 
effectively  and  ultimately  result  in  improved  quality  of  resident  care  in 
nursing  homes. 

Process 

Wisconsin  has  had  an  integrated  survey  and  IoC  review  process  since  1973, 
and  the  QAP  initiated  changes  in  both  processes,  beginning  with  the  use 
of  criteria  to  determine  which  facilities  were  eligible  for  a  screening 
survey  and/or  a  sampling  IoC.  Surveyors  could  elect  to  screen  an  average 
or  better  facility  using  10  key  quality  criteria.  The  screening  criteria 
were  identified  by  a  panel  of  long-term  care  experts  to  focus  more 
directly  on  quality  of  care  delivery  and  less  on  paperwork  requirements. 
In  nursing  homes  with  poor  compliance  records  and  in  homes  where 
screening  results  suggested  problems,  surveyors  would  carry  our  either  a 
traditonal  full  survey  of  the  entire  1,547  State  and  Federal  regulations 
or  a  partial  survey  pursuing  specific  problems  identified  by  the  screen. 
Surveys  were  conducted  in  approximately  2  days  by  Wisconsin's  traditional 
four  person  team  including  a  nurse,  sanitarian,  social  worker  and 
engineer,  but  QAP  stressed  a  multi-disciplinary  team  approach,  and  the 
sharing  of  findings.  (Prior  to  QAP,  surveyors  in  each  discipline  did  not 
routinely  visit  a  facility  at  the  same  time.) 

The  resident  assessment  part  of  the  QAP  (IoC  review)  allowed  surveyors  to 
conduct  an  intensive  review  of  a  resident  sample  (initially  10,  later  20 
percent)  rather  than  the  Federally-mandated  review  of  all  Medicaid 
residents,  again  based  on  the  facility's  quality  of  care  history.  The 
intensive  review  consisted  of  a  resident  interview  and/or  examination,  a 
record  review,  and  staff  Interviews  conducted  by  a  team  consisting  of  a 
nurse,  social  worker  and  physician  when  needed.  The  underlying 
assumption  was  that  if  a  facility's  system  for  providing  adequate  quality 
of  care  was  functioning  for  a  sample  of  residents,  it  was  functioning  for 
all  residents.  If  the  home  failed  the  sample,  the  traditional  100 
percent  IoC  review  was  triggered.  QAP  also  stressed  the  explicit 
integration  of  survey  and  IoC  findings  in  determining  what  citations 
should  be  issued. 

Evaluation 

Wisconsin  Health  Care  Research,  Inc.  (WHCRI)  conducted  the  formal 
evaluation  of  the  Wisconsin  demonstration  project.  Based  on  an 
experimental  design  which  compared  the  QAP  to  Wisconsin's  traditional 
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methods,  WHCRI  found  no  evidence  of  either  improvement  or  deterioration 
in  quality  of  care  in  nursing  homes  under  QAP  methods,  as  measured  by  the 
number  of  cited  deficiencies.  There  were  no  significant  differences  in 
terms  of  compliance  with  regulations,  frequency  of  repeat  problems  and 
overall  Medicaid  reimbursement  to  nursing  homes.  WHCRI  found  that  QAP 
surveyors  could  produce  survey  and  IoC  results  using  screening  and 
sampling  techniques  that  were  comparable  to  results  of  traditional 
methods,  with  fewer  total  staff  hours. 

This  time  savings  was  consistent  across  nursing  homes  of  all  quality; 
there  was  no  increase  in  time  reallocation  to  poor  quality  homes.  The 
evaluation  did  indicate  that  the  QAP  detected  significantly  more  severe 
deficiencies  and  that  deficiencies  were  more  resident  centered,  while  the 
old  method  tended  to  detect  more  deficiencies  of  documentation  (54 
percent  of  QAP  deficiencies  classified  as  resident  centered,  32  percent 
under  traditional  survey). 

Not  surprisingly,  the  results  of  this  first  demonstration  were  not 
exactly  what  the  State  had  anticipated.  Although  there  was  no  evidence 
of  surveyor  time  reallocation,  the  results  clearly  indicated  that  the 
potential  existed  for  cost-effective  changes  in  the  traditional  survey 
system  without  loss  of  quality.  In  summarizing  its  findings,  WHCRI  cited 
the  long-term  potential  for  increased  quality:  "Had  QAP  carried  out  more 
timely  monitoring  of  nursing  home  performance  from  a  statewide 
perspective  and  provided  needed  feedback,  upgrading  of  quality  of  care 
might  have  occured  more  as  proposed."  The  evaluators  also  noted  that  the 
latitude  afforded  surveyors  in  deciding  whether  an  expanded  survey  or  IoC 
review  was  needed  tended  to  work  against  consistency  in  the  screening 
process,  and  possibly  cut  down  on  the  potential  for  time  reallocation. 

Massachusetts 

The  Massachusetts  Department  of  Public  Health  conducted  a  formal 
demonstration  of  its  Survey  by  Exception  (SBE)  process  from  July  1980  to 
September  1982.  Massachusetts'  modified  process  was  based  on  the  premise 
that  the  intensity  of  regulatory  effort  in  each  facility  should  be  geared 
to  the  needs  of  that  facility.  The  major  objective  of  SBE  was  to  reduce 
surveyor  time  spent  on  routine  activities  in  the  higher  quality 
facilities  in  order  to  permit  reallocation  of  surveyor  time  to  the  poorer 
quality  facities.  It  was  anticipated  that  such  a  system  would  maintain  a 
constant  quality  of  care  in  acceptable  and  outstanding  facilities  while 
producing  improved  quality  in  facilities  with  poor  past  performance 
records. 

Process 

Under  the  SBE  system,  nursing  homes  were  classified  into  three  groups 
based  upon  their  performance  histories.  These  classifications  determined 
which  type  of  survey  was  to  be  performed.  Facilities  rated  outstanding 
received  a  screening  survey  consisting  of  an  examination  of  ten  broad 
areas  of  patient  care  conducted  by  a  single  surveyor  through  a  one  day 
"walk  through"  Inspection.  Facilities  with  acceptable  records  of  past 
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performance  were  surveyed  with  an  abbreviated  Instrument  consisting  of  54 
regulatory  items  from  the  traditional  survey.  These  54  Items  were 
selected  by  Massachusetts  as  the  most  important  regulatory  requirements 
and  were  by  nature  more  focused  and  specific  than  the  areas  examined 
under  the  screening  survey.  In  all  cases  where  a  screening  or 
abbreviated  survey  was  used,  the  surveyor  could  make  an  on-site  decision 
to  Increase  the  Intensity  of  the  survey  up  to  a  full  survey.  All 
facilities  classified  as  poor  performers  received  the  full  traditional 
survey,  consisting  in  Massachusetts  of  627  items.  One  additional  change 
Instituted  under  the  SBE  process  was  a  reduction  from  two  person  survey 
teams  to  a  single  registered  nurse.  No  changes  were  implemented  in  the 
State's  IoC  review  system,  which  remained  completely  separate  from  the 
survey  process. 

Evaluation 

Mathematica  Policy  Research,  Inc.  (MPR)  conducted  the  formal  evaluation 
of  the  Massachusetts  demonstration  project.  The  evaluation  design 
included  the  use  of  control  nursing  homes  in  Massachusetts,  permitting  a 
direct  comparison  of  the  impact  of  the  new  and  old  survey  methods  during 
the  same  time  period.  The  major  findings  of  the  evaluation  were  as 
fol lows: 

1)  Screening  and  abbreviated  surveys  took  less  time  to  complete  than 
traditional  surveys,  resulting  in  an  overall  decrease  of  10.6 
percent  in  average  surveyor  time  per  facility  under  the  SBE 
process.  (Note  that  time  allocation  comparisons  for  both 
Massachusetts  and  New  York  are  based  on  time  estimates  constructed 
from  the  survey  records,  which  MPR  determined  were  more  reliable 
than  the  States'  time  reporting  systems.) 

2)  There  was  an  increase  in  time  spent  1n  low  quality  homes  (14.5 
percent)  and  a  substantial  decrease  1n  high  quality  homes  (-31.9 
percent),  indicating  that  Massachusetts'  new  method  did  produce  a 
reallocation  of  surveyor  resources  toward  low  quality  facilities. 

3)  Surveyors  under  the  new  method  detected  significantly  less  total 
deficiencies,  although  this  decrease  was  not  reflected  in  the  number 
of  formal  citations,  but  only  in  recommendation-type  (uncited) 
deficiencies.  The  total  number  of  deficiencies  remained  constant  in 
low  qual 1ty  homes. 

4)  MPR  detected  a  "highly  significant"  Increase  1n  the  average  severity 
of  deficiencies  detected  under  the  new  survey  method,  due  to  the 
higher  frequency  of  deficiencies  in  resident  care  and 
environment/infection  control  areas  as  opposed  to  administrative 
deficiencies. 

Although  Mathematica  supported  the  overall  screening/sampling  approach 
implemented  by  Massachusetts,  they  cited  a  number  of  design  weaknesses  In 
the  State's  process.  Some  of  these  weaknesses,  such  as  the  non-existent 
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use  of  guidelines  and  the  lack  of  linkage  between  the  screening  survey 
and  applicable  State  and  Federal  codes,  were  offset  to  a  large  degree  by 
the  very  high  of  caliber  of  nurse  surveyors  in  Massachusetts.  With  less 
experienced  surveyors,  MPR  felt  that  the  State's  system  may  not  have 
functioned  nearly  as  well.  Mathematica  also  recommended  a  much  larger 
resident  sample  size  for  intensive  review,  stating  that  without  an 
integrated  IoC  and  survey  process,  the  SBE  screening  instrument  was 
inadequate  in  terms  of  resident-specific  information  due  to  its  very 
limited  sample  size  of  2-3  residents.  As  a  result,  surveyors  were 
sometimes  unwilling  to  approve  a  facility  based  solely  on  the  screen  and 
tended  to  follow  it  with  an  abbreviated  survey  in  order  to  satisfy  their 
own  standards.  In  conjunction  with  increasing  the  in-depth  review  sample 
size,  another  recommendation  was  that  Massachusetts  augment  its  survey 
teams  by  adding  a  second  team  member  (usually  a  non-RN)  in  all  but  the 
smallest  homes.  Finally,  MPR  recommended  that  the  State  integrate  its 
IoC  and  survey  review  processes. 

New  York 

In  September  1980,  New  York's  Department  of  Health  was  approved  to 
conduct  a  demonstration  involving  modifications  to  both  the  survey  and 
inspection  of  care  processes  until  September  1983.  The  demonstration  was 
subsequently  approved  for  continuation  until  implementation  of  the  new 
national  survey  process.  As  detailed  in  Chapter  Nine,  HCFA  is  now 
considering  a  proposal  to  further  extend  New  York's  innovative  IoC 
process  to  explore  how  the  State's  IoC  process,  along  with  its 
experimental  reimbursement  design,  will  interface  with  the  new  survey 
process.  Like  in  Wisconsin  and  Massachusetts,  the  primary  goal  of  New 
York's  demonstration  was  to  reallocate  surveyor  resources  to  marginal  or 
poor  facilities  and  improve  the  quality  of  care  in  these  facilities. 
This  involved  the  development  of  a  streamlined  IoC  and  survey  process 
that  prioritized  activities  dealing  most  directly  with  the  resident  care 
process  while  de-emphasizing  areas  of  perceived  paper  compliance.  New 
York's  demonstration  project  included  a  modified  IoC  process,  integration 
of  IoC  findings  into  the  survey  process,  and  a  new  survey  process  based 
on  screening  concepts. 

Process 

The  revised  IoC  process  consisted  of  a  two-stage  review  of  eleven  items 
known  as  Sentinel  Health  Events  (SHEs)  intended  to  focus  directly  on 
patient  care.  Based  on  regulatory  items,  the  SHEs  were  essentially 
negative  outcomes  (such  as  cases  of  decubiti,  indwelling  catheters),  the 
presence  of  which  were  evaluated  for  each  resident  in  a  facility  through 
a  structured  protocol  of  resident  observation  and  record  review.  During 
Stage  I,  reviewers  determined  the  incidence  of  SHEs  among  all  residents 
and  then  compared  the  level  of  incidence  for  each  SHE  to  a  Statewide  norm. 

If  the  Incidence  level  exceeded  the  norm,  a  Stage  II  review  was 
triggered,  consisting  of  a  structured  review  of  each  occurence  of  the  SHE 
to  determine  whether  the  facility  employed  the  proper  preventative  and 
therapeutic  measures  1n  its  care  process.  As  with  the  Stage  I  revljsw, 
findings  were  compared  with  statewide  norms,  and  If  the  proportion  of 
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problems  exceeded  the  norm,  the  facility  failed  that  particular 
protocol.  If  the  facility  failed  Stage  II  either  overall  or  for  a 
particular  SHE,  these  findings  influenced  the  scope  of  the  survey,  which 
typically  followed  immediately  after  the  IoC  review. 

New  York's  new  survey  methodology  utilized  four  sources  of  information  to 
determine  compliance:  State  agency  files  on  facility  history,  a  Facility 
Survey  Report  (FSR)  form  completed  by  each  provider,  IoC  results,  and  an 
abbreviated  onsite  inspection.  The  FSR  covered  organizational  structure 
requirements  based  almost  entirely  on  documentation.  The  onsite  survey 
was  a  highly  focused  review  encompassing  250  essential  Federal  and  State 
requirements  (compared  to  1250  items  under  the  traditional  survey). 
Based  on  the  findings  of  the  abbreviated  survey  and  the  IoC  review,  the 
survey  team  used  set  criteria  to  decide  whether  to  conduct  a  more 
intensive  survey.  An  intensive  survey  could  consist  of  either  a  full 
review  of  all  the  traditional  survey  items  or  a  partial  survey  of  the 
traditional  items  in  just  those  conditions  or  standards  that  were  out  of 
compliance. 

One  final  noteworthy  change  under  New  York's  new  system  is  that 
deficiencies  were  cited  only  if  standard  or  condition  level  requirements 
were  not  met.  As  long  as  the  associated  standard  was  in  compliance, 
element  level  deficiencies  were  not  cited  as  formal  code  violations  but 
noted  as  deficiencies  in  the  survey  team's  informal  recommendations.  The 
impact  of  this  change  would  be  evident  in  the  evaluation  results. 

Evaluation 

Like  in  Massachusetts,  MPR  conducted  the  formal  evaluation  of  New  York's 
demonstration  project.  Since  the  State  implemented  its  new  system  on  a 
statewide  basis  in  1981,  the  evaluation  design  of  necessity  utilized  a 
before-after  comparison  technique.  The  primary  conclusions  of  the 
evaluation  were  as  follows: 

1.  "Strong  and  consistent"  evidence  indicated  a  substantial  reduction 
in  surveyor  time  under  New  York's  new  methodology,  and  most  of  this 
reduction  could  be  traced  to  survey,  rather  that  IoC  activities. 

2.  MPR  found  no  evidence  of  any  time  reallocation  from  high  to  low 
quality  homes.  However,  a  New  York  State  study  did  evidence  such 
reallocation,  and  the  issue  has  been  further  addressed  during  the 
extension  of  the  demonstration. 

3.  Under  the  new  methodology,  there  was  a  large  and  significant 
decrease  1n  the  average  number  of  deficiencies  cited  and  a  slightly 
smaller  but  still  significant  increase  in  the  number  of  deficiencies 
noted  as  recommendations.  Further  analysis  showed  that  this  net 
decrease  in  deficiencies  was  confined  almost  entirely  to  high 
quality  homes  though,  and  across  all  homes,  surveyors  using  the  new 
method  were  more  likely  to  cite  conditions  and  standards  as  out  of 
compl lance. 
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4.   The  average  severity  of  deficiency  increased  under  the  new  method, 
with  a  greater  average  severity  for  both  recommendations  and 
citations.  This  increase  in  average  severity  was  more  than  offset 
by  the  decreases  in  total  deficiencies  detected,  resulting  in  a 
decline  in  the  total  severity  per  facility. 

In  its  overall  assessment  of  New  York's  new  system,  MPR  stated  that  it 
was  very  well  designed  but  that  there  were  some  shortcomings  in  the 
implementation  of  the  process,  particularly  in  the  area  of  survey/IoC 
linkage.  They  recommended  complete  integration  of  survey  and  IoC 
reviews,  rather  than  just  a  required  sharing  of  findings.  MPR  also 
suggested  that  NY  develop  a  way  of  ensuring  the  correction  of  element 
level  deficiencies  that  were  being  addressed  only  as  informal 
recommendations  by  survey  teams. 

As  in  each  of  the  other  demonstrations,  the  findings  in  New  York  solidly 
supported  the  theory  that  a  modified  survey  methodology  could  produce 
overall  time  savings,  although  time  reallocation  to  lower  quality 
facilities  could  not  be  consistently  shown.  MPR  stated  its  belief  that, 
"Given  the  overall  reduction  in  time,  the  prospects  for  meaningful 
reallocation  exists  under  the  new  methods."  Such  time  reallocations 
should  eventually  result  in  quality  improvements  in  the  facilities  that 
need  it  most.  Further,  the  evaluation  concluded  that  New  York's  modified 
survey  process  was  an  "effective  and  efficient  vehicle"  that  was  "helping 
reduce  the  paperwork  load  and  encouraging  closer  examination  of 
resident-centered  issues." 

Cal ifornia 

In  an  effort  to  increase  the  efficiency  of  its  survey  and  certification 
program,  the  California  State  survey  agency  submitted  a  proposal  in  1981 
to  conduct  an  experimental  survey  methodology  in  the  State's  skilled 
nursing  facilities  (SNFs).  The  intent  of  California's  Abbreviated  Survey 
Process  (ASP)  was  to  reduce  the  time  and  costs  involved  in  surveying  SNFs 
while  maintaining  acceptable  quality  of  care.  California's  basic  premise 
was  that  continued  annual  surveys  were  critical  but  that  the  intensity  of 
the  survey  should  vary  according  to  the  performance  of  the  facility.  The 
California  experiment  was  approved  by  HSQB  from  10/81  until  9/84. 

Process 

California's  ASP  consisted  of  three  major  elements: 

An  abbreviated  survey  form  composed  of  152  of  the  534  Federal 
requirements,  chosen  for  their  direct  relationship  to  resident 
health  and  safety; 

A  facility  self-questionnaire,  to  be  filled  out  by  the 
administrator  and  key  staff,  covering  another  104 
organizational-type  items;  and 
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A  protocol  detailing  facility  eligibility  for  the  ASP  as  well 
as  critieria  for  when  surveyors  must  revert  to  surveys  of 
greater  intensity. 

The  ASP  was  designed  to  serve  both  as  a  time-saving  device  and  a 
screening  mechanism  to  alert  the  survey  team  to  serious  problems.  If  no 
problems  were  found  using  the  abbreviated  form,  it  was  assumed  that 
deficiencies  in  unsurveyed  requirements  would  have  little  impact  on 
resident  welfare.  Any  finding  that  a  standard  was  not  met  caused  the 
applicable  Condition  of  Participation  to  be  surveyed  in  its  entirety.  If 
a  surveyor  determined  non-compliance  with  a  condition,  the  full 
traditional  survey  was  instituted.  The  ASP  was  not  designed  for 
application  to  all  SNFs  but  only  to  those  facilities  with  good  compliance 
hi  stories. 

Evaluation 

Approval  for  the  California  experiment  was  granted  contingent  on  the 
development  of  an  evaluation  methodology  by  HCFA's  Division  of  Health 
Standards  and  Quality  (DHSQ),  Region  IX.  The  Regional  Office  developed 
the  California  Abbreviated  Survey  Evaluation  System  (CASES),  a  12-month 
review  that  was  implemented  from  October  1981  to  October  1982.   The 
CASES  methodology  was  based  mainly  on  the  analysis  of  Federal  monitoring 
surveys  of  75  percent  of  all  California  SNFs,  as  well  as  some 
before-after  ASP  analysis  of  deficiency  and  time  utilization  data. 

The  major  findings  of  CASES  were  as  follows: 

1)  The  ASP  was  used  in  45  percent  of  all  California  SNFs  with  an 
average  of  36  percent  time  savings  in  surveying  those  facilities. 

2)  Abbreviated  surveys  produced  a  16  percent  savings  in  survey  expenses 

3)  Surveyors  exhibited  an  apparent  tendency  to  be  "more  lenient"  in 
identifying  nursing  and  pharmaceutical  deficiencies  in  facilities 
receiving  the  ASP. 

4)  Statistical  analysis  indicated  that  eight  survey  items,  primarily  in 
the  areas  of  infection  control  and  drug  administration,  needed  to  be 
added  to  the  ASP  because  of  potential  for  impact  on  quality  of 
patient  care.  (These  items  were  added  to  the  ASP  during  the 
experiment's  extension  period.) 

Developed  foremost  as  a  cost-saving  measure,  California's  ASP  was  limited 
In  the  respect  that  it  addressed  no  fundamental  reforms  but  simply 
experimented  with  a  reduced  number  of  items  from  the  traditional  survey 
form.  In  that  the  ASP  requirements  were  closely  aligned  with  an  early 
set  of  HCFA  "key  requirements",  the  experiment  did  serve  to  pinpoint 
areas  that  needed  to  be,  and  have  been,  more  fully  addressed  in  the 
modified  national  survey  Instrument.  In  addition,  the  California 
experiment  reinforced  the  overall  belief  that  a  cost-effective  survey 
process  could  be  designed  wh.ich  could  achieve  continued  quality  assurance 
by  focusing  on  those  Items  most  directly  related  to  patient  care. 
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Washington 

In  October  1981,  Washington's  Bureau  of  Nursing  Home  Affairs  submitted  a 
proposal  to  conduct  a  modified  survey  process  (MSP),  which  was  designed 
to  reduce  overall  surveying  time,  reallocate  limited  resources  to  poor 
facilities  and  to  focus  on  the  actual  provision  of  care  rather  than  on  a 
facility's  structural  capacity  for  adequate  care.  Washington's 
experiment  was  approved  to  continue  until  the  initiation  of  the  new 
national  survey  process. 

Process 

The  primary  feature  of  the  MSP  was  the  abbreviated  survey  form  which  is 
utilized  in  all  long-term  care  facilities.  This  form  retained  all 
regulatory  requirements  directly  related  to  resident  health  and  safety 
while  eliminating  those  identified  as  "paper  compliance,"  i.e.,  items 
focusing  on  internal  management  practices  and  documentation.  Washington 
assumed  that  compliance  with  the  targeted  requirements  would  assure  that 
a  facility  met  the  standards  concerning  the  structural  framework  of  care 
delivery.  The  State  developed  guidelines  that,  together  with  the 
shortened  form,  attempted  to  define  the  specific  intent  of  each 
regulation  in  relation  to  the  care  needs  of  the  residents.  (As 
originally  conceived,  the  MSP  also  included  a  system  of  extended  survey 
cycles  based  on  specific  criteria  related  to  a  facility's  survey  results 
and  compliance  history.  However,  this  system  remained  in  effect  for  only 
1  year  after  which  Washington  resumed  annual  surveys.)  A  final  facet  of 
the  MSP  was  a  performance-based  criteria  set  for  determining  whether 
facilities  needed  onsite  follow-up  surveys,  in  contrast  to  the  previous 
system  of  100  percent  onsite  follow-ups. 

Evaluation 

The  Hesperides  Group  conducted  the  formal  evaluation  of  Washington's  MSP, 
submitting  its  final  report  in  March  1985.  Earlier  in  the  experiment, 
DHSQ  Region  X  had  conducted  its  own  evaluation  of  the  MSP,  but  Washington 
had  objected  to  some  of  the  findings  based  on  perceived  weaknesses  in  the 
study  design. 

Consequently,  both  the  State  and  the  regional  office  were  involved  in 
developing  the  design  of  the  Hesperides  evaluation,  which  examined  the 
comparability  of  the  MSP  with  the  traditional  Federal  survey  process  In 
the  areas  of  deficiency  findings  and  resource  utilization.  The 
evaluation  consisted  of  dual  surveys  of  21  randomly  selected  State 
nursing  homes  by  four  two-person  surveyor  teams.  Each  home  received  both 
a  traditional  survey  and  the  MSP  within  a  1-week,  period.  The  results  of 
the  evaluation  are  summarized  below: 

1)   The  MSP  was  more  likely  to  recertify  a  facility  than  was  the 

traditional  process.  However,  this  finding  was  clouded  by  the  fact 
that  one  of  the  traditional  survey  teams  was  especially  prone  to 
citing  conditions  out  of  compliance,  thus  denying  recertif Ication. 
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2)  Although  the  MSP  cited  more  severe  deficiencies,  the  traditional 
process  cited  a  greater  number  of  deficiencies.  Deficiency  findings 
were  notably  similar  in  such  key  areas  as  nursing  and  medical  care 
and  patient  safety. 

3)  The  MSP  moved  less  readily  from  marking  out  elements  and  standards 
to  marking  out  conditions,  even  when  supporting  deficiencies  were 
severe.  In  general,  the  total  number  of  deficiencies,  rather  than 
their  severity,  was  a  stronger  influence  on  the  surveyor's  decision 
to  mark  out  both  standards  and  conditions  and  on  the  overall 
certification  decision. 

4)  The  MSP  did  not  vary  significantly  from  the  traditional  process  in 
terms  of  surveyor  resource  utilization.  This  finding  was  in 
variance  with  the  State's  own  prior  data  indicating  a  4-5  hour  time 
saving  per  survey  using  the  MSP.  Interestingly,  prior  data  also 
showed  that  State  surveyors  during  the  study  found  twice  as  many 
deficiencies  as  had  been  noted  in  the  most  recent  past  State  survey, 
possibly  indicating  greater  thoroughness  on  the  part  of  study 
surveyors. 

In  summary,  the  results  of  the  Hesperides  Group  evaluation  were  generally 
in  agreement  with  the  previous  Region  X  evaluation  of  the  Washington 
experiment,  which  indicated,  based  on  limited  evidence,  that  the  MSP 
produced  fewer  deficiency  citations  and  more  lenient  certification 
decisions  than  the  traditional  process.  Neither  evaluation  was 
particularly  conclusive,  and  as  Hesperides  stated,  "...these  results 
present  a  picture  of  two  acceptable  processes  which  are  fairly  comparable 
in  their  outcomes  although  different  in  their  interests."  The  evaluation 
results  did  provide  some  insight  into  which  areas  of  care  delivery  were 
better  reviewed  by  the  traditional  survey,  and  thus  needed  to  be 
carefully  addressed  in  the  national  modified  process. 

Iowa 

From  January  1983  until  the  Implementation  of  the  new  national  survey 
process,  the  Iowa  Department  of  Health  was  approved  to  conduct  Its 
Outcome-Oriented  Survey  (00S)  process  In  intermediate  care  facilities, 
composing  90  percent  of  the  State's  nursing  homes.  The  Intent  was  to 
shift  the  emphasis  of  the  survey  process  as  much  as  possible  from 
policies  and  procedures  to  measurable  outcomes  of  services  provided. 

Process 

The  OOS  was  a  screening  device  that  led  to  Indepth  review  where 
necessary.  A  condensed  version  of  Iowa's  traditional  form,  the  OOS  form 
contained  only  those  requirements  considered  critical  Indications  of  the 
quality  of  health  care  provided  to  nursing  home  residents  (about  150  of 
the  700  traditional  Items).  Under  the  OOS  system,  a  single  surveyor 
normally  applied  the  screening  instrument  in  each  facility.  One  notable 
element  of  the  screening  survey  was  the  random  selection  of  a  10  resident 
sample  for  Intensive  review.  Including  private  Interviews  and  a  review  of 
medical  records  and  care  plans.  Throughout  the  OOS  form,  a  significant 
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effort  was  made  to  utilize  a  concrete,  quantitative  measurement  system, 
replacing  "yes  or  no"  answers  with  scale  measures  wherever  possible. 
This  system  was  intended  to  lead  surveyors  through  the  decision-making 
process  and  eventually  to  produce  a  numerical  data  base  for  facility 
evaluation  and  problem  identification. 

After  review  of  the  00S  results,  Iowa  used  thresholds  for  determining  if 
a  more  intensive  survey  was  needed.  Administrative  staff  determined 
whether  further  review  was  necessary,  and  if  so,  either  a  partial  or  full 
survey  was  performed  by  a  nurse  other  than  the  one  who  completed  the 
00S.  Iowa  estimated  that  partial  and/or  full  surveys,  based  on  its 
traditional  licensure  survey,  were  triggered  in  about  10  percent  of 
facilities  since  January  1983. 

Evaluation 

Rehabilitation  Care  Consultants,  Inc.  (RCC)  conducted  the  formal 
evaluation  of  Iowa's  OOS  process.  Major  elements  of  the  evaluation 
design  included: 

1.  A  detailed  comparison  of  a  sample  of  Federal  and  OOS  surveys  to 
determine  the  degree  of  agreement  on  the  number  and  severity  of 
deficiencies  found;  and 

2.  Validation  activities  such  as  the  performance  by  RCC  of  both  Federal 
and  OOS  surveys,  as  well  as  the  application  of  an  independent 
quality  assessment  tool  in  a  much  smaller  sample  of  nursing  homes. 

The  primary  conclusion  of  RCC's  analysis  was  that  Iowa's  experimental 
process  identified  fewer  problems,  and  problems  of  less  severity,  than 
did  the  traditional  Federal  survey.  These  findings  held  true  even  when 
analysis  was  restricted  to  those  areas  covered  by  both  survey  instruments. 

RCC  identified  a  number  of  problems  in  both  the  design  and  the 
application  of  the  OOS  process  that  had  implications  for  the  national 
implementation  of  a  modified  survey  process.  For  example,  RCC 
recommended  that  the  practice  of  selecting  a  set  number  of  residents  at 
random  for  intensive  review  be  changed  to  at  least  a  partially  targeted 
sample  with  sample  size  proportional  to  resident  population.  In  terms  of 
application,  RCC  noted  that  some  Iowa  surveyors  failed  to  use  the  summary 
section  of  the  OOS  form,  and  had  a  generally  negative  attitude  toward  the 
new  process  based  on  their  perception  that  the  new  tool  severely 
restricted  professional  judgment  in  reporting  problems.  Problems  of  this 
nature  highlighted  the  need  for  surveyor  training  and  clear  guidelines  in 
order  to  minimize  surveyor  mi sperceptions  and  achieve  uniformity  1n  the 
national  implementation  process.  Finally,  RCC  concluded,  as  did 
Mathematica  In  Its  evaluation  of  the  Massachusetts  demonstration,  that  at 
least  two  surveyors  were  needed  on  each  inspection  team. 

Rhode  Island 

Rhode  Island  was  the  final  State  approved  by  HCFA  to  develop  and  conduct 
an  experimental  survey  approach.  Originally  approved  as  an  experiment 
from  October  1983  until  September  1986,  Rhode  Island's  planned 
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methodology  stressed  the  elimination  of  "paper  review"  and  the 
intensified  review  of  resident  care,  emphasizing  the  assessment  of 
resident  outcomes.  The  State  intended  to  capitalize  on  its  integrated 
IoC/survey  review  system  by  using  the  resident  care  assessments  in  the 
IoC  process  for  all  resident  care  components  of  the  survey  process. 

As  Rhode  Island  began  to  develop  a  draft  survey  instrument  and  an 
experimental  application  design,  several  factors  came  to  light  that 
eventually  resulted  in  the  combination  of  the  Rhode  Island  process  with 
the  PaCS  survey  process.  First,  it  was  apparent  that  there  were 
significant  similarities  between  the  State's  approach  and  the  newly 
developed  PaCS  process.  In  addition,  demonstration  results  from  the  two 
other  States  with  integrated  IoC/survey  review  systems,  Wisconsin  and  New 
York,  were  beginning  to  indicate  the  efficacy  of  many  of  the  same 
concepts  proposed  for  further  testing  in  Rhode  Island.  Finally,  HCFA 
realized  that  its  own  modified  survey  process  was  close  to  being  ready 
for  extensive  testing  and  that  a  "laboratory"  for  rigorous  testing  would 
be  needed. 

In  May  1984,  HCFA  staff  proposed  to  the  Rhode  Island  Department  of  Health 
that  the  State  merge  its  developing  methodology  with  the  PaCS  process  and 
serve  as  an  evaluation  site  for  the  proposed  national  process.  Such  a 
merger  offered  the  following  major  advantages: 

o    Rhode  Island  had  already  been  working  in  conjunction  with  Brown 
University's  Long-Term  Care  Gerontology  Center  on  developing  an 
experimental  design  for  a  comprehensive  project  evaluation  that  was 
readily  adaptable  for  HCFA's  purposes. 

o    The  State's  prior  commitment  to  the  concept  of  outcome-oriented 
surveys  ensured  a  high  degree  of  acceptance  of  the  new  survey 
process  among  surveyor  staff. 

Rhode  Island  agreed  to  HCFA's  proposal  and,  during  the  summer  of  1984, 
staff  from  the  State's  Division  of  Facilities  Regulation  worked  with  HCFA 
staff  to  incorporate  selected  procedural  elements  and  resident  evaluation 
indicators  from  the  State's  proposed  survey  form  into  the  PaCS  form  and 
process.  The  merger  was  completed  prior  to  the  initiation  of  national 
testing  of  the  PaCS  process  in  December  1984. 
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CHAPTER  THREE 
PaCS:  THE  EARLY  STAGES 


Introduction 

The  new  national  long-term  care  survey  process  being  implemented  in  1986 
is  the  product  of  an  extended  developmental  effort.  HCFA's  continuing 
objective  has  been  to  provide  a  better  link  between  facility  surveys  and 
care  review  through  a  revision  of  the  traditional  survey  forms  and 
process. 

In  1982,  HCFA  staff  evaluated  numerous  survey  and  IoC  approaches  and 
instruments  in  an  effort  to  identify  and  categorize  specific  performance 
indicators  directed  at  the  care  actually  provided  by  the  facilities. 
They  also  reviewed  the  various  models  governing  the  use  of  these 
indicators.  The  review  encompassed  a  wide  range  of  programs  including 
the  formal  State  demonstrations  and  experiments,  other  States'  integrated 
IoC/survey  procedures,  former  Professional  Standards  Review  Organizations 
review  systems,  industry  quality  assurance  tools,  and  unrealized  past 
Federal  approaches  such  as  the  Patient  Care  Management  System  and  the 
Patient  Appraisal  and  Care  Evaluation  instruments.  Drawing  on  each  of 
these  sources,  HCFA  staff  completed  development  of  the  original  version 
of  the  PaCS  survey  instrument  in  September  1983.  Although  the  subsequent 
testing  and  refinement  process  have  resulted  in  numerous  revisions  to  the 
PaCS  form  and  procedures,  the  new  long-term  care  survey  process  maintains 
the  essential  features  of  PaCS.  The  new  approach  continues  to  emphasize 
review  of  the  provision  of  resident  care  and  services  through  an 
integrated  system  of  resident  observation,  interviews  and  record  reviews. 

The  First  PaCS  Trial 

The  original  PaCS  instrument  was  used  for  the  first  time  on 
October  15-18,  1983.  Central  office  surveyors  conducted  a  pretest  of  the 
tool  in  three  Maryland  nursing  homes  to  see  if  it  was  a  viable  review 
mechanism.  The  surveyors  recommended  several  changes  in  the  length  and 
formatting  of  the  survey  form  but  agreed  that  further  testing  was 
merited.  After  instituting  the  recommended  revisions,  HCFA  unveiled  the 
PaCS  instrument  to  the  groups  involved  in  the  Subpart  S  meetings  in 
November  1983,  and  with  their  support,  prepared  for  its  first  formal 
field  testing. 

Pilot  Test  1 

Following  2  days  of  surveyor  training  in  December  1983,  PaCS  was  field 
tested  in  three  regions  between  12/16/83  and  1/20/84.  The  test  involved 
the  performance  of  parallel  PaCS  and  traditional  surveys  in  four 
facilities  In  each  region,  encompassing  a  cross-section  of  compliance 
histories.  For  comparability  purposes,  both  sets  of  surveys  were  limited 
to  2  days  and  restricted  to  the  same  resident  record  sample.  The  study 
was  intended  to  provide  an  indication  of  the  effectiveness  of  PaCS  in 
terms  of  quality,  cost,  and  administration,  as  well  as  to  Identify  areas 
of  the  tool  In  need  of  refinement. 
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Findings  of  the  pilot  test  supported  the  continued  refinement  of  the  new 
survey  process.  PaCS  and  traditional  surveyors  tended  to  Identify  the 
same  general  problem  areas  (e.g.,  restorative  care,  nursing  services)  but 
differed  1n  the  specific  provisions  cited.  PaCS  surveyors  more 
frequently  noted  direct  care  problems  (e.g.,  aseptic  techniques, 
ambulation),  while  traditional  surveyors  more  often  Identified 
organizational  or  structural  problems  (e.g.,  nursing  policies, 
maintenance  of  equipment).  A  comparison  of  findings  did  reveal  a 
weakness  in  the  PaCS  process  in  the  area  of  infection  control  and 
sanitation.  Problems  in  those  areas  usually  turned  up  through  the 
Inspection  of  equipment,  storage  areas,  kitchens,  etc.,  which  was  not 
originally  included  in  the  PaCS  review. 

Early  indications  were  that  the  PaCS  survey  could  be  completed  in  an 
hour's  less  time  than  the  traditional  survey,  despite  the  greater  amount 
of  time  spent  on  the  facility  tour  and  resident  focused  review  under 
PaCS.  Surveyors  and  facility  staff  expressed  a  generally  favorable 
reaction  to  the  new  system,  particularly  Its  emphasis  on  care  review  as 
opposed  to  paper  compliance.  Residents  liked  the  idea  of  being  more 
Involved  in  the  survey  process  although  it  was  suggested  that  the  length 
of  the  resident  interviews  needed  to  be  reduced.  Other  recommendations 
produced  by  the  first  PaCS  pilot  testing  included: 

o    Refine  the  PaCS  forms  to  make  them  more  concise  and  easier  to  follow 
through  by  individual  resident. 

o    Provide  more  space  for  surveyor  notes  and  commentary. 

o    Supplement  the  PaCS  survey  with  a  conventional  review  of  infection 
control  and  sanitation. 

o    Emphasize  interviewing  and  observational  skills  in  the  PaCS  survey 
or  training  program. 

Despite  the  small  size  of  the  sample,  HCFA  was  encouraged  by  the  result 
of  the  pilot  test  and  continued  its  efforts  on  a  number  of  fronts  to 
achieve  eventual  national  Implementation  of  a  modified  long-term  care 
survey  process.  Program  staff  began  working  with  the  Office  of 
Management  and  Budget  (0MB)  to  obtain  forms  clearance  to  implement 
large-scale  national  testing  of  the  PaCS  process.  At  the  same  time,  they 
continued  refining  the  format  and  content  of  the  survey  instrument  based 
on  results  of  the  Initial  testing  as  well  as  subsequent  comments  from  the 
American  Health  Care  Association  (AHCA),  the  National  Council  of  Health 
Centers  (NCHC),  and  the  American  Association  of  Homes  for  the  Aging 
(AAHA).  The  State  of  Rhode  Island,  which  had  been  1n  the  process  of 
developing  Its  own  resident-centered  survey  methodology,  also  took  part 
1n  the  refinement  effort,  agreeing  to  participate  in  an  Intensive 
evaluation  of  the  national  model  instrument  rather  than  continuing  to 
develop  its  own  tool.  A  second  small  scale  pilot  test  of  the  PaCS 
process  was  scheduled  in  order  to  gain  some  experience  with  the  refined 
Instrument.  HCFA  than  contracted  with  Rehabilitation  Care  Consultants, 
Inc.,  (RCC)  to  obtain  an  independent,  professional  assessment  of  the  tool 
through  a  review  of  its  components,  observation  pf  the  pilot  surveys  and 
utilization  of  the  tool  by  RCC  staff. 
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Pilot  Test  2 

The  PaCS  model  was'field  tested  for  a  second  time  in  Kentucky,  Illinois 
and  Pennsylvania  from  July  16  to  August  8,  1984.  Once  again,  Federal 
surveyors  performed  parallel  PaCS  traditional  surveys  under  controlled 
conditions  to  ensure  comparability.  The  nine  participating  facilities 
were  volunteers  from  the  AAHA,  AHCA  and  NCHC. 

Results  of  the  second  pilot  test  were  similar  to  the  earlier  findings  in 
that  the  new  survey  process  detected  more  resident  care  problems  but  was 
judged  in  need  of  further  format  changes  to  enhance  ease  of  use.  The  one 
PaCS  surveyor  who  had  also  taken  part  in  the  previous  pilot  test 
consistently  identified  a  greater  number  of  overall  deficiencies  than  the 
traditional  surveyor  (particularly  in  such  resident-related  areas  as 
activities,  social  services,  physician  services,  nutrition),  indicating 
the  possibility  of  a  2-3  survey  learning  curve  for  effective  use  of  the 
new  process.  Although  the  second  pilot  test  did  not  detect  any  time 
savings  under  the  PaCS  methodology,  there  was  a  clear  redistribution  of 
survey  time  to  resident-oriented  activities  such  as  observation, 
interview  and  record  review.  (Note  that  the  infection  control  and 
sanitation  areas  were  more  fully  covered  in  this  version  of  the  tool, 
probably  accounting  for  the  lack  of  any  time  savings.)  Surveyors  made 
the  following  specific  recommendations  for  improving  the  process: 

o    Reduce  the  length  of  the  resident  observation/interview  form,  if 
possible  using  a  checklist  format. 

o    Develop  a  better  vehicle  for  summarizing  findings. 

o    Provide  procedural  guidelines  applicable  to  each  portion  of  the 
survey  form. 

Overall  reaction  from  surveyors,  facilities  and  residents  continued  to  be 
favorable. 

RCC's  Independent  assessment  of  the  new  survey  method  was  based  on  a 
detailed  review  of  each  of  the  components  of  the  PaCS  form  and 
guidelines,  observation  of  the  instrument  in  use  by  a  Federal  surveyor, 
and  RCC's  own  utilization  of  the  PaCS  forms.  Citing  the  soundness  of  the 
PaCS  concept,  RCC  stressed  the  need  for  a  thorough  and  consistent 
training  program  to  educate  State  surveyors  in  both  the  philosophy  and 
Implementation  procedures  of  an  outcome-oriented  process.  Other  major 
recommendations  stemming  from  RCC's  descriptive  analysis  included: 

o    Decrease  the  cumbersome  nature  of  the  working  instrument  by 
separating  all  background  and  guideline  type  Information. 

o    Add  a  one-page  facility  tour  worksheet  to  the  working  Instrument. 

o    Develop  separate  and  expanded  procedural  guidelines  applicable  to 
each  portion  of  the  form,  emphasizing  the  guidelines  for  the  general 
fad  Hty  tour. 
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o    Expand  the  eating  assistance  observation  section  to  include 

crossmatching  of  diet  cards  and  physician's  order  with  actual  meals 
served  for  a  sample  of  residents. 

o    Include  interviews  with  facility  staff  in  the  survey  process. 

o    Emphasize  importance  of  surveyor  judgment  in  selection  of  a  targeted 
resident  sample  for  indepth  review. 

RCC  also  made  several  recommendations  related  to  the  PaCS  care 
guidelines,  such  as  additional  or  amended  care  indicators  addressing 
catheters,  colostomies,  decubiti  and  others.  All  of  the  above  major 
recommendations  and  many  of  the  more  specific  suggestions  were  eventually 
incorporated  into  the  new  long-term  care  survey  process. 

Preparation  for  National  Testing 

Following  the  two  encouraging  pilot  tests,  HCFA  staff  began  to  prepare  in 
earnest  for  large-scale  national  testing  of  the  PaCS  process,  pending 
departmental  clearance  of  the  survey  forms.  After  making  further 
refinements  to  PaCS  based  on  surveyor  and  RCC  recommendations  from  the 
second  pilot  test,  they  submitted  the  modified  forms  to  0MB  and  requested 
approval  to  have  States  conduct  PaCS  surveys  in  nursing  homes  with 
particularly  good  compliance  histories.  Approval  was  requested  to  have 
the  majority  of  States  perform  PaCS  surveys  in  from  3-20  facilities, 
depending  on  the  total  number  of  facilities  in  the  State,  and  to  have 
surveyors  complete  a  questionnaire  regarding  their  impressions  of  the 
PaCS  forms  and  process.  HCFA  also  requested  permission  to  conduct  a 
formal  test  of  the  PaCS  process  in  Rhode  Island,  Tennessee  and 
Connecticut,  involving  an  extended  group  of  facilities  in  each  of  these 
States. 

During  the  latter  part  of  1984,  as  the  PaCS  forms  made  their  way  through 
the  departmental  clearance  process,  HCFA  began  to  train  surveyors  in 
using  the  PaCS  process.  Surveyors  from  Rhode  Island,  Tennessee  and 
Connecticut  received  training  in  October.  During  November  and  December 
1984,  HCFA  staff  conducted  a  series  of  training  workshops  to  instruct 
surveyor  representatives  from  all  regional  offices  and  States  in  using 
PaCS.  Despite  some  opposition  from  surveyors  who  felt  that  the  PaCS  form 
was  too  long  and  cumbersome,  there  was  strong  overall  support  for  the 
concept  of  resident-oriented  surveys  focusing  on  care  delivery  and 
outcomes  rather  than  process.  The  training  staff  also  encountered 
significant  surveyor  misunderstanding  as  to  the  intent  of  the  PaCS 
process,  especially  the  perception  that  PaCS  was  a  shortened  survey 
process  that  omitted  regulatory  requirements  and  resulted  1n  less 
paperwork  for  the  surveyor.  When  it  was  emphasized  that  the  form  was 
being  implemented  on  a  trial  basis  and  that  further  revisions  to  both  the 
form  and  the  process  would  be  made  based  on  test  results  and  surveyor 
suggestions,  they  expressed  a  general  willingness  to  cooperate. 

The  Executive  Office  of  Management  and  Budget  granted  approval  for  States 
to  begin  using  the  PaCS  forms  and  questionnaires  1n  January  1985.  Brown 
University  has  conducted  the  formal  evaluation  of  the  PaCS  process  In  the 
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three  demon stratiorf  States  of  Rhode  Island,  Tennessee  and  Connecticut, 
where  surveyors  conducted  PaCS  surveys  throughout  1985.  Both  RCC  and  the 
HCFA  regional  offices  have  conducted  evaluations  of  the  limited  national 
testing,  which  took  place  in  the  other  47  States  between  February  1  and 
June  30,  1985.  Ensuing  sections  of  this  report  discuss  the  objectives, 
design  and  results  of  this  two-track  evaluation  effort. 
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CHAPTER  FOUR 
THREE=STATE  FORMAL  TESTING  OF  THE  NEW  SURVEY  PROCESS 


Introduction 

Brown  University's  Long  Term  Care  Gerontology  Center  has  conducted  the  formal 
evaluation  of  the  new  long-term  care  survey  methodology.  The  Brown  evaluation 
was  based  on  the  result  of  extensive  testing  of  the  PaCS  process  during  late 
1984  and  1985  in  the  States  of  Rhode  Island,  Tennessee  and  Connecticut.  It 
focused  on  the  reliability  and  validity  of  the  new  survey  process  and  also 
examined  such  important  sub-issues  as  resource  utilization  and  surveyor  and 
facility  acceptance.  Presented  below  is  a  report  on  the  design  and  objectives 
of  the  study,  as  well  as  a  discussion  of  Brown's  preliminary  findings  based  on 
the  partial  data  now  available.  Complete  results  of  the  evaluation  will  be 
avai 1  able  by  June  1986. 

Demonstration  States 

Rhode  Island,  Tennessee  and  Connecticut  comprised  the  formal  laboratory  for 
testing  the  new  survey  process  prior  to  its  national  implementation.  The 
selection  of  these  demonstration  States  was  based  both  on  their  willingness  to 
participate  in  the  evaluation  and  on  the  diversity  that  the  States  had  to 
offer  in  terms  of  facility  type,  team  size  and  composition,  and  review 
approach.  Their  continuing  cooperation  in  the  timely  performance  of  scheduled 
surveys  as  well  as  the  allotment  of  valuable  staff  time  to  participate  in  the 
PaCS  implementation  workgroup  was  invaluable  to  the  refinement  of  the  new 
survey  methodology. 

Rhode  Island  was  the  first  State  selected  for  formal  testing  of  the  modified 
survey  process.  As  noted  earlier,  Rhode  Island  had  developed  its  own 
outcome-oriented  survey  process  in  consultation  with  Brown  University.  Late 
in  1983,  Rhode  Island  applied  to  HCFA  to  conduct  a  State  experiment.  In  view 
of  the  progress  that  had  been  made  towards  implementation  of  a  new  national 
survey  protocol,  HCFA  decided  not  to  initiate  another  experiment,  but  to 
attempt  to  enlist  the  State's  cooperation  in  refining  and  testing  the  PaCS 
process.  Rhode  Island  was  agreeable  to  this  suggestion,  and  its  staff 
collaborated  with  Federal  staff  to  incorporate  elements  of  the  Rhode  Island 
process  into  PaCS.  In  addition  to  improving  the  Federal  survey  design,  the 
collaboration  with  Rhode  Island  also  offered  the  advantage  of  Brown 
University's  evaluation  methodology,  which  had  been  specifically  developed  for 
the  State's  outcome-oriented  process.  This  evaluation  protocol  was  expanded 
to  encompass  the  other  two  demonstration  States. 

The  second  State  selected  for  participation  in  the  formal  PaCS  testing  was 
Tennessee.  Like  Rhode  Island,  Tennessee  had  submitted  in  May  1984  a  proposal 
for  an  integrated  survey  and  inspection  of  care  review  experiment.  HCFA  again 
responded  that  the  time  table  for  Implementing  a  revised  national  survey  model 
did  not  permit  further  experimentation  by  Individual  States,  and  Instead, 
obtained  the  State's  consent  to  take  part  1n  testing  the  national  model. 
Although  both  Rhode  Island  and  Tennessee  had  Integrated  survey  and  IoC 
reviews,  Tennessee  employed  a  less  Intensive  IoC  procedure  based  on  the  100 
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percent  review  of  selected  key  indicators  (as  opposed  to  Rhode  Island's  100 
percent  in-depth  review).  Tennessee  also  offered  an  opportunity  to  test  the 
national  model  with  very  large  survey  teams  (at  least  eight  members)  in  an 
environment  of  predominantly  intermediate  care  facilities,  in  contrast  to 
Rhode  Island's  4-5  member  teams  surveying  a  mixture  of  SNFs  and  ICFs. 

Connecticut  was  the  final  State  that  agreed  to  participate  in  the  PaCS 
demonstration.  In  contrast  to  Rhode  Island  and  Tennessee,  Connecticut 
maintained  a  non-integrated  system  of  surveys  and  IoC  reviews.  Nearly  all  of 
the  State's  nursing  homes  were  dually  certified  (as  SNFs  and  ICFs)  and  survey 
team  size  and  composition  depended  on  individual  home  characteristics  such  as 
size  and  deficiency  history.  Connecticut's  basic  PaCS  survey  team  was 
composed  of  two  nurses,  as  opposed  to  the  larger,  multi-disciplined  teams 
prevalent  in  Rhode  Island  and  Tennessee. 

Evaluation  Issues 

Brown's  evaluation  of  the  new  survey  methodology  included  four  major  areas  of 
investigation:  deficiency  detection,  impact  on  resident  outcomes,  consistency 
of  problem  identification  and  deficiency  citation,  and  a  comparison  of 
surveyor  costs.  The  evaluators  also  collected  and  analyzed  information  on  the 
perceptions  of  nursing  home  administrators  and  staff  and  all  involved 
surveyors  regarding  the  PaCS  process  through  detailed  questionnaires  to  each 
group.  Other  issues  explored  by  the  evaluation  include:  the  effectiveness  of 
the  PaCS  sampling  process  and  selection  criteria,  effectiveness  of  triggers, 
assessment  of  process  problems  using  PaCS,  ability  of  surveyors  to  accurately 
calculate  ADL  (Activities  of  Daily  Living)  scores,  the  appropriate  future  use 
of  ADL  score  changes,  and  the  relative  effectiveness  of  PaCS  in  SNFs  versus 
ICFs  and  "poor"  facilities  versus  "good"  facilities. 

Evaluation  Design 

Each  of  the  three  involved  States  had  a  distinct  experimental  design.  These 
designs  were  tailored  by  Brown  to  meet  the  variability  of  processes  in  each 
State  while  at  the  same  time  addressing  the  long  list  of  research  issues  in 
which  HCFA  was  interested. 

The  most  sophisticated  research  design  was  implemented  in  Rhode  Island,  where 
nursing  homes  were  randomly  assigned  into  an  experimental  group  and  a  control 
group.  Double  surveys  were  administered  in  the  60  experimental  homes,  with 
the  traditional  team  preceding  the  PaCS  team  in  homes  surveyed  prior  to  April 
1  and  the  order  reversed  in  homes  surveyed  after  that  date.  Only  the  PaCS 
survey  team  provided  the  experimental  group  homes  with  exit  interviews  and 
official  deficiency  findings.  In  the  control  group,  consisting  of 
approximately  45  homes,  only  the  traditional  survey  was  administered.  This 
design  permited  a  comparison  of  PaCS  versus  traditional  findings  in  the 
experimental  homes  as  well  as  a  comparison  of  traditional  survey  results  1n 
the  control  versus  experimental  homes,  thus  assessing  the  possible  Impact  of 
experimental  conditions  on  the  traditional  survey  outcomes.  Since  the  Rhode 
Island  sample  contained  a  good  mix  of  SNF  and  ICF  homes,  Brown  was  able  to 
compare  the  ability  of  the  PaCS  process  to  evaluate  quality  1n  two  different 
settings  within  one  State.  Rhode  Island's  100  percent  Intensive  IoC  review 
also  provided  the  longitudinal  resident  level  data  (such  as  ADL  scores)  needed 
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for  a  study  of  the  impact  of  the  new  survey  process  on  resident  outcomes. 
Finally,  Rhode  Island  surveyors  initiated  the  use  of  onsite  portable  computers 
to  collect  resident-specific  data  from  the  in-depth  sample,  an  innovation  with 
significant  future  implications. 

The  evaluation  design  in  Connecticut  also  called  for  surveyors  to  conduct  both 
traditional  and  PaCS  surveys,  this  time  in  45  nursing  homes  with  the  exit 
interview  and  deficiency  findings  given  by  the  traditional  team.  The  45-home 
sample  was  then  stratified  into  three  15-home  groups  reflecting  the  perceived 
quality  of  the  homes  based  on  an  analysis  of  deficiency  data  from  previous 
years.  Through  this  stratification,  Brown  could  provide  some  insight  into  the 
effectiveness  of  the  PaCS  process  in  nursing  homes  of  different  quality. 

In  Tennessee,  the  new  survey  process  was  administered  in  all  three  regions  in 
the  State,  encompassing  about  90  nursing  homes.  Since  a  double  survey  design 
comparing  traditional  and  PaCS  results  was  not  feasible,  analysis  of  the  new 
survey's  impact  on  deficiency  findings  had  to  be  based  on  comparison  with 
prior  year  deficiency  data.  In  one  region  in  Tennessee,  however,  surveyors 
conducted  follow-up  PaCS  surveys  in  30  homes  immediately  following  the  initial 
PaCS  survey.  This  design  was  intended  to  permit  assessment  of  inter-rater 
reliability  in  terms  of  problem  and  deficiency  determination  using  the  new 
methodology.  Brown  also  analyzed  PaCS  deficiency  findings  from  both  Tennessee 
and  Connecticut  to  examine  the  efficacy  of  the  10  percent  resident  sample  for 
intensive  review  and  the  related  selection  criteria. 

Evaluation  Results 

Although  the  final  evaluation  report  is  not  scheduled  for  submission  until 
June  1986,  Brown  provided  HCFA  with  a  series  of  interim  reports  presenting  its 
preliminary  findings.  These  "results"  should  be  approached  with  the 
understanding  that  they  are  based  on  partial  data  and  cannot  be  statistically 
verified  until  final  data  is  available.  Some  of  the  proposed  research  issues, 
such  as  the  impact  of  PaCS  on  resident  outcomes,  could  not  be  addressed  with 
the  available  data.  The  questions  that  were  analyzed  using  the  preliminary 
data  include: 

o   What  is  the  impact  of  PaCS  on  the  number,  types,  and  severity  of 
deficiencies? 

How  effective  is  the  triggering  approach? 

To  what  extent  is  PaCS  appropriate  for  both  SNFs  and  ICFs,  and  to 
what  extent  does  it  work  in  different  quality  homes? 

o   To  what  extent  are  surveyors  consistently  deciding  when  a  problem  1s  a 
deficiency? 

o   To  what  extent  does  PaCS  compare  with  the  traditional  survey  1n  terms  of 
resource  use? 

o   To  what  extent  1s  the  PaCS  methodology  consistent  across  survey  teams? 

o   How  accurate  are  PaCS  surveyors  1n  monitoring  ADL  scores? 
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o   What  are  the  impressions  of  nursing  home  administrators  and  nursing 
directors  regarding  the  PaCS  process? 

o   What  are  the  impressions  of  surveyors  regarding  the  PaCS  process? 

A  discussion  of  the  preliminary  findings  in  each  of  these  areas  follows. 

Impact  of  PaCS  on  Deficiencies 

The  primary  measure  of  nursing  home  quality  of  care  provided  by  the  survey 
process  is  the  deficiency.  In  addition  to  tabulating  total  deficiencies  from 
each  survey,  Brown  developed  three-tier  classification  systems  to  examine  the 
type  and  severity  of  each  deficiency. 

As  displayed  in  Table  1,  Brown  found  that  PaCS  survey  teams  cited  considerably 
more  deficiencies  in  Tennessee,  somewhat  more  deficiencies  in  Rhode  Island, 
and  considerably  fewer  deficiencies  in  Connecticut  than  did  teams  using  the 
traditional  survey.  A  breakdown  of  the  total  deficiencies  into  discrete 
categories  revealed  that  the  substantially  lower  deficiency  total  in 
Connecticut  could  be  attributed  mainly  to  a  large  reduction  in  the  average 
number  of  documentation  deficiencies.  Moreover,  the  PaCS  team  in  Connecticut 
still  found  more  patient  care  deficiencies,  and  a  much  higher  proportion  of 
patient  care  deficiencies,  than  did  surveyors  in  the  other  two  demonstration 
States.  In  all  three  States,  the  PaCS  teams  found  a  higher  proportion  of 
patient  care  deficiencies.  Another  significant  finding  was  that  the  PaCS 
survey  was  equally  or  more  effective  than  the  traditional  process  in  detecting 
evironmental  deficiencies,  with  evidence  of  more  environmental  deficiencies  in 
Rhode  Island  and  Tennessee,  and  a  higher  proportion  of  such  deficiencies  in 
Connecticut.  (This  finding  is  notable  in  that  the  physical  environment  review 
portion  of  the  new  survey  process  had  been  strengthened  on  the  recommendation 
of  surveyors  who  took  part  in  the  PaCS  pilot  testing.) 

TABLE  1 
Deficiencies  by  Type,  Survey  Type,  and  State 


Connecticut 


PaCS   Traditional 


Rhode  Island 
PaCS   Traditional 


Tennessee 


PaCS   Traditional 


Patient  Care 
Documentation 
Environment 
Total 


2.93  4.00 

(45.85)*     (21.89) 


2.33 
(36.46) 

1.13 
(17.68) 

6.67 


12.47 
(68.25) 

1.80 
(9.85) 

19.40 


1.57 
(25.24) 

3.65 
(58.68) 

1.00 
(16.08) 

7.71 


0.88 
(17.81) 

3.78 
(76.52) 

0.28 
(5.67) 

6.19 


2.43 
(21.02) 

7.11 
(61.51) 

2.02 
(17.47) 

13.46 


1.16 
(15.83) 

4.44 
(60.57) 

1.73 
(23.60) 

8.05 


*Percentages  are  of  the  summation  of  Patient  Care,  Documentation,  and 
Environment,  not  Total. 
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(Note:  Patient  Care,  Documentation,  and  Environment  categories  include  only 
tags  that  are  uniqtfe  in  substance  to  avoid  double  counting.  No  conditions  are 
included,  but  some  standards  are  included.  Many  standards  duplicate  substance 
of  elements.  Total  deficiencies  include  all  tags  cited.  Therefore,  total 
deficiencies  is  larger  than  the  sum  of  the  categories  by  the  number  of 
conditions  and  the  number  of  "non-unique"  standards.) 

In  terms  of  severity,  Brown  found  that  few  condition  level  deficiencies  were 
cited  using  either  survey  method.  In  both  Rhode  Island  and  Tennessee,  the 
PaCS  teams  cited  more  standards  and  critical  deficiencies  than  did  the 
traditional  teams  while  the  reverse  was  true  in  Connecticut  (see  Table  2). 
Condition  level  deficiencies  are  generally  the  most  severe  while  standard 
level  deficiencies  are  serious  but  not  enough  to  warrant  facility  closure. 
Critical  deficiencies  combine  standards  with  elements  to  represent  problems 
that  are  judged  important  to  ensuring  the  health  and  safety  of  residents. 
Brown  indicated  that  the  most  clearcut  finding  in  this  area  was  that  the  PaCS 
process  was  citing  significantly  more  severe  deficiencies  in  Tennessee. 

TABLE  2 
Severity  of  Deficiencies  by  Survey  Type  and  State 

Connecticut*        Rhode  Island*  Tennessee* 

Severity  Measures  PaCS  Traditional    PaCS  Traditional    PaCS  Traditional 

Conditions         —  0.07        —  0.05  0.04  0.44 

Standards         0.20  0.93  2.05  0.86  4.38  2.62 

Criticals         0.13  0.40  0.71  0.24  2.00  0.76 

*  Average  per  home. 

Triggering 

As  implemented  1n  the  1985  testing,  the  PaCS  process  included  a  triggering 
mechanism  to  prompt  the  review  of  certain  policy  and  procedure  items  when  a 
deficiency  Is  cited  in  a  related  patient  care  area.  In  the  traditional  process, 
these  items  were  always  reviewed  directly.  As  would  be  expected.  Brown  found 
that  the  triggering  process  resulted  in  fewer  deficiency  citations  for  these 
Items,  providing  for  the  reduction  in  documentation-type  deficiencies  found  with 
PaCS.  The  triggering  mechanism  was  deleted  from  the  new  national  survey 
methodology  based  on  the  lack  of  any  conclusive  supportive  evidence  from  Brown 
or  from  RCC's  process-oriented  evaluation,  as  well  as  overwhelmingly  negative 
feedback  on  triggerlng's  utility  from  PaCS  surveyors.  The  new  methodology  still 
permits  surveyors  to  verify  compliance  with  requirements  not  Included  1n  the 
PaCS  process,  at  their  discretion. 

PaCS  1n  Different  Quality  Facilities 

Brown's  evaluation  of  the  PaCS  survey  results  in  nursing  homes  of  different 
quality,  which  was  drawn  solely  from  Connecticut  facilities,  indicated  slightly 
fewer  deficiencies  using  PaCS  1n  the  "good"  quality  group  and  considerably  fewer 
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deficiencies  in  the  "average"  and  "poor"  groups.  These  differences  were 
attributed  almost  totally  to  differences  in  the  number  of  documentation 
deficiencies.  Brown  noted  that  the  reduced  reporting  of  documentation  problems 
under  the  PaCS  system  has  apparently  changed  the  State's  perceptions  of  the 
quality  of  many  of  its  nursing  homes. 

PaCS  in  SNFs  and  ICFs 

The  final  element  of  Brown's  analysis  of  deficiency  findings  concerned  the 
ability  of  the  PaCS  process  to  evaluate  care  in  SNFs  as  opposed  to  ICFs.  Based 
on  a  sample  of  20  Rhode  Island  homes,  Brown  found  that  the  new  process  had  much 
more  impact  in  the  intermediate  care  setting.  In  ICFs,  the  PaCS  team  found  6.75 
deficiencies  per  home,  compared  with  2.38  per  home  found  under  the  traditional 
process.  In  SNFs,  there  was  a  less  pronounced  difference,  with  the  PaCS  team 
identifying  6.50  deficiencies  per  home,  while  the  traditional  team  found  5.67 
per  home.  The  final  evaluation  report  will  present  further  analysis  in  this 
area. 

Consistency  of  Deficiency  Citations 

Under  the  new  survey  methodology,  surveyors  complete  an  observation/interview 
record  review  form  (OIRR)  for  each  resident  who  is  included  in  the  intensive 
review  sample.  The  OIRR  form  is  a  checklist  for  recording  negative  findings 
directly  associated  with  patient  care.  As  Brown's  preliminary  report  pointed 
out,  the  PaCS  recording  process  provides  substantial  insight  into  criteria  used 
in  the  decision-making  process  for  determining  deficiencies,  thus  making 
feasible  an  analysis  of  the  consistency  of  support  for  deficiency  citations. 
This  is  in  contrast  to  the  traditional  survey  where  there  was  no  formal  problem 
identification  and  surveyors  rely  on  informal  notes  to  document  deficiencies. 

Brown  performed  a  detailed  analysis  of  the  OIRR  form  from  each  PaCS  survey  to 
ascertain  whether  a  relationship  existed  between  the  number  of  "negative 
findings"  and  the  number  of  patient  care  deficiencies  cited.  Table  3 
summarizes  Brown's  preliminary  findings,  presenting  a  State-by-State  breakdown 
of  the  median  total  negative  findings  and  the  number  of  negative  findings  per 
observed  resident  for  homes  with  differing  numbers  of  patient  care  deficiency 
citations.  Listed  below  each  State  1s  the  number  of  facilities  on  which  the 
data  is  based. 


-  31  - 


TABLE  3 
Patient  Care  Deficiencies  versus  Negative  Findings 


Patient  Care 

Median  #  of 

Median  Negative 

Deficiencies 

Total  Negative 

Findings  per 

Findings 

Resident 

Connecticut 

0  -  1 

85.0 

7.1 

(N=15) 

2-3 

72.0 

7.1 

4-5 

82.0 

7.5 

Tennessee 

0 

58.0 

3.8 

(N=46) 

1 

61.5 

5.1 

2-3 

61.0 

4.2 

4-5 

73.0 

6.9 

6+ 

130.0 

8.4 

Rhode  Island 

0 

325.0 

11.4 

(N=18) 

1 

759.0 

11.1 

2  -  3 

761.0 

11.4 

4+ 

797.5 

11.7 

Keeping  in  mind  that  surveyors  in  Rhode  Island  conducted  intensive  review  on  a 
much  larger  but  somewhat  less  disabled  sample,  there  was  still  a  large 
cross-state  variation  in  the  number  of  negative  findings  per  resident.  The 
average  number  of  negative  findings  per  resident  ranged  from  6.0  in  Tennessee  to 
7.6  in  Connecticut  to  11.5  in  Rhode  Island.  Brown  noted  that  only  in  Tennessee 
did  a  demonstrably  positive  relationship  exist  between  the  number  of  negative 
findings  per  resident  and  the  number  of  patient  care  deficiencies,  (ranging  from 
3.8  in  homes  without  deficiencies  to  8.4  in  homes  with  six  or  more 
deficiencies),  although  in  all  three  States  the  highest  number  of  average 
negative  findings  correlated  with  the  homes  with  the  greatest  number  of  patient 
care  deficiencies.  Brown  also  indicated  that  there  was  generally  a  positive 
relationship  between  the  total  number  of  negative  findings  and  the  number  of 
deficiencies,  with  the  most  pronounced  relationship  again  being  found  in 
Tennessee  (ranging  from  58  such  findings  in  homes  without  deficiencies  upward  to 
82  problems  in  homes  with  six  or  more  deficiencies  sited).  The  results  from 
Tennessee  were  particularly  encouraging  because  the  majority  of  all  homes 
included  in  this  sample  came  from  that  State  (46  of  79  homes,  58  percent).  HCFA 
will  continue  to  evaluate  the  consistency  of  the  relationship  between  negative 
findings  and  cited  deficiencies  as  surveyors  gain  more  experience  with  the  new 
survey  methodology,  since  there  was  some  evidence  of  Inconsistent  use  of  the 
OIRR  form  during  the  testing  period.  Unlike  its  predecessor,  the  new  survey 
process  has  the  potential  to  produce  numerical  norms  and  standards  for 
determining  when  patient  care  problems  warrant  deficiency  citations,  once  1t  has 
been  in  use  long  enough  to  establish  base-line  data. 

Resource  Util ization 

Brown's  resource  use  analysis  was  based  on  time  distribution  Information 
submitted  by  Individual  team  members  In  the  experimental  States.  Since  there 
were  differences  among  the  survey/IoC  review  approaches  of  the  three  States  (see 
the  Evaluation  Design  section),  Brown's  analysis  concentrated  on  1ntra-State 
comparisons.  The  evaluation  structure  permitted  a  direct  comparison  of 
traditional  and  PaCS  survey  time  only  1n  Connecticut  and  Rhode  Island;  no 
traditional  surveys  were  done  1n  Tennessee.  Brown  found  that  the  PaCS  team  1n 
Connecticut  spent  considerably  less  person-hours  per  home  than  the  traditional 
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team  members  (an  average  of  20.9  person  hours  per  PaCS  survey  versus  33.3 
person  hours  per  traditional  survey),  but  more  time  in  all  areas  of  resident 
review — e.g.,  increased  nurse  review  time  per  resident,  increased  overall 
average  time  spent  in  sample  resident  record  review,  interview  and 
observation.  Specifically,  PaCS  surveyors  spent  65.9  percent  of  their  total 
time  in  Intensive  resident  review  compared  to  26.6  percent  for  the  traditional 
surveyors,  including  a  reported  21.0  percent  interviewing  time  under  PaCS 
versus  6.8  percent  during  the  traditional  survey. 

In  Rhode  Island,  Brown  reported  that  the  PaCS  teams  spent  more  person-hours 
per  home  than  the  traditional  team  (55.0  hours  versus  46.8  hours),  with  very 
similar  distributions  of  time  for  both  of  surveys.  For  example,  the 
proportion  of  total  interviewing  and  direct  observation  time  was  29.1  per  cent 
with  PaCS  and  27.8  with  the  traditional  survey.  Average  surveyor  record 
review  time  was  somewhat  higher  using  PaCS,  indicating  that  surveyors  may  have 
been  experiencing  problems  coordinating  the  PaCS  record  review  process  with 
their  IoC  review  responsibilities.  The  greater  average  time  spent  in  patient 
interviewing  and  observation  in  Rhode  Island  could  be  attributed  to  the 
inclusion  of  the  IoC  sample  with  the  survey. 

Although  a  time  comparison  of  PaCS  and  the  traditional  survey  was  not  possible 
in  Tennessee,  Brown  reported  that  the  amount  and  distribution  of  record 
review,  interview  and  observation  was  similar  to  that  of  Connecticut. 
Tennessee's  nine-member  teams  spent  an  average  of  58.6  person  hours  per 
facility,  with  19.7  percent  of  that  time  reportedly  spent  in  interviewing 
residents. 

Overall,  the  preliminary  resource  utilization  findings  reflected  the  new 
methodology's  potential  for  redirecting  and  eventually  saving  surveyor  time 
while  maintaining  or  increasing  the  efficacy  of  the  survey.  The  time 
distribution  results  in  Connecticut  were  particularly  notable  since,  as  a 
State  without  an  integrated  survey/IoC  process,  Connecticut  most  typified  the 
review  structure  1n  the  majority  of  the  non-experimental  States.  Although 
data  on  total  survey  time  may  be  influenced  by  the  varying  team  sizes  across 
States  and  survey  types,  increases  in  the  proportion  of  direct  resident  review 
time  would  be  a  significant  step  forward.  The  procedural  guidelines  for  the 
new  survey  methodology  contain  recommendations  to  reduce  the  variability  in 
survey  team  size  in  order  to  Increase  the  uniformity  and  efficiency  of  the  new 
survey  process.  HCFA  also  anticipates  that  once  surveyors  have  more 
experience  with  the  PaCS  methodology  and  forms,  there  may  be  consistent  time 
savings  associated  with  the  new  process. 

Inter-rater  Reliability 

The  double  PaCS  survey  format  in  Tennessee  was  designed  to  test  the 
consistency  of  PaCS  findings  across  survey  teams.  Since  the  double  survey 
results  were  available  from  only  three  of  thirty  scheduled  facilities,  Brown's 
preliminary  report  contained  no  conclusive  findings  on  Inter-rater  reliability 
using  PaCS.  Early  results  unexpectedly  showed  that  In  each  case,  the  second 
survey  team  to  enter  the  home  found  more  deficiencies  that  did  the  first, 
prompting  some  concern  about  experimental  design  features  (e.g.,  which  team 
should  give  the  exit  Interview?).  Brown's  final  report  will  not  only  examine 
the  consistency  1n  the  number  and  type  of  deficiencies  but  also  explore 
whether  the  variability  is  in  the  detection  of  problems  or  1n  the 
determination  of  what  problems  are  severe  enough  to  warrant  a  deficiency. 
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ADL  Scores 

Nursing  homes  in  Rhode  Island  have  begun  to  perform  functional  assessment  on 
residents  using  the  Katz  ADL  scale,  a  measure  developed  by  Dr.  Sidney  Katz  to 
ququantify  a  resident's  ability  to  perform  basic  activities  such  as  bathing, 
dressing,  toileting,  etc.  This  information,  which  Is  of  great  potential  use  for 
case  mix  reimbursement  systems,  has  been  verified  and  collected  on  a  sample 
basis  in  the  State  by  nurse  interviewers  from  Brown  with  extensive  training  and 
experience  in  this  area.  As  part  of  the  Rhode  Island  experiment,  surveyors  were 
Instructed  to  calculate  an  ADL  score  on  the  PaCS  form  for  each  sample  resident 
based  on  medical  record  information  concerning  functional  levels  at  admission. 
Brown  then  matched  these  scores  with  the  verified  ADL  assessments  collected  by 
the  trained  interviewers  to  determine  the  accuracy  of  the  scores  calculated  by 
the  surveyors.  This  comparison  revealed  only  a  35.7  percent  level  of  matching 
scores  and  a  considerable  number  of  large  discrepancies  between  the  surveyor 
scores  and  the  nurse  interviewer  scores. 

Surveyors  were  also  Instructed  to  assess  the  accuracy  of  the  latest  ADL  score  1n 
the  record  after  completing  their  observation  and  interview  of  each  sample 
resident.  Brown's  final  report  will  include  a  comparison  of  these  current  (as 
opposed  to  admission-based)  ADL  scores.  However,  the  preliminary  data  clearly 
indicated  that  surveyors  requird  more  extensive  training  on  determining  ADL 
scores  than  the  two  sessions  provided  the  Rhode  Island  surveyors  in  order  to 
accurately  determine  ADL  scores.  For  the  present  time,  the  new  national  survey 
process  does  not  require  surveyors  to  score  residents  in  ADLs.  HCFA  will 
reevaluate  the  feasibility  of  requiring  surveyors  to  do  ADL  scoring  after 
surveyors  have  been  trained  in  and  gain  experience  with  the  more  fundamental 
elements  of  the  new  survey  methodology. 

Impressions  of  Nursing  Home  Administrators 

Brown's  preliminary  report  presented  the  results  of  52  approximately  one-hour 
interviews  with  nursing  home  administrators  who  had  experienced  the  PaCS  survey 
process.  The  Directors  of  Nursing  Services  (DNS)  were  also  present  at  most  of 
the  interviews.  Although  these  interviews  provided  admittedly  subjective 
information,  a  surprising  majority  of  the  administrator/DNS  group  shared 
opinions  on  many  aspects  of  the  process. 

The  administrator/DNS  group  reported  diverse  levels  of  knowledge  about  the  PaCS 
process  both  before  and  during  the  demonstration  project,  but  previous  knowledge 
levels  or  attitudes  had  no  measurable  affect  on  their  opinions  about  the  new 
methodology.  Overall,  they  supported  the  concept  of  a  more  resident-oriented, 
less  paper-oriented  survey  process.  They  reported  similar  relative  burdens  for 
both  survey  processes  In  such  areas  as  surveyor  time  in  the  facility,  disruption 
to  staff  and  residents  and  preparation  time.  The  majority  of  respondents  (57.7 
percent)  agreed  that  new  survey  process  focused  on  more  valuable  information 
than  the  traditional  survey  while  only  two  administrators  (3.8  percent)  felt 
that  1t  focused  on  less  valuable  Information.  Two-thirds  of  the 
administrator/DNS  group,  reported  that  the  PaCS  process  provided  a  better 
assessment  of  the  quality  of 
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nursing  home  care.  Thus  after  experiencing  a  PaCS  survey,  the  group  supported 
not  only  the  concept  of  a  resident-oriented  survey  but  also  the  ability  of  the 
new  survey  process  to  successfully  embody  this  concept,  with  over  80  percent 
stating  that  they  would  prefer  a  PaCS  survey  to  the  traditional  process. 

Impressions  of  Surveyors 

Brown  conducted  interviews  with  a  sample  of  34  surveyors  who  had  participated  in 
the  PaCS  demonstration  to  determine  their  impressions  of  the  new  methodology. 
The  interviews  focused  on  their  perceptions  of  the  efficiency  and  effectiveness 
of  each  form  involved  in  the  PaCS  process,  along  with  some  general  questions 
concerning  the  overall  process.  As  with  the  administrator/DNS  group,  the 
majority  of  surveyors  appeared  to  concur  on  many  aspects  of  the  process. 

One  area  of  the  PaCS  process  that  generated  nearly  unanimous  support  was  the 
drug  pass  form.  Nearly  90  percent  of  the  surveyors  felt  that  this  was  a 
positive  addition  to  the  survey  methodology  with  the  remaining  respondents 
unsure.  The  accompanying  pharmacy  record  review  summary  also  received  solid 
support  with  about  50  percent  of  surveyors  citing  it  as  a  positive  addition 
while  only  one  surveyor  saw  this  review  as  a  negative  addition.  On  the  other 
hand,  demonstration  State  surveyors  were  consistently  opposed  to  other  elements 
of  the  experimental  process,  particularly  the  PaCS  tally  sheet  and  triggering 
mechanism.  Fully  75  percent  of  the  respondents  favored  elimination  of  the  tally 
sheet,  over  50  percent  opted  to  eliminate  triggering  and  87  percent  reported 
either  that  they  never  used  the  triggers  or  that  the  triggers  were  not  helpful 
in  providing  guidance  for  additional  review.  These  findings,  in  conjunction 
with  similar  feedback  from  other  surveyors  experienced  with  PaCS,  contributed 
heavily  to  HCFA's  decision  not  to  include  the  tally  sheet  and  the  formal 
triggering  mechanism  in  the  new  long-term  care  survey  process. 

A  large  majority  of  surveyors  (75  percent)  supported  the  elimination  of  required 
review  of  policies  and  procedures,  with  nearly  two-thirds  of  the  surveyors 
interviewed  agreeing  that  such  review  was  usually  unnecessary  to  determine  the 
quality  of  patient  care.  Notwithstanding  general  concurrence  that  a 
resident-oriented  survey  could  best  help  to  ensure  quality  care,  the  surveyors 
made  clear  that  a  more  standardized  information  collection  process  could  succeed 
only  if  It  were  "workable"  in  the  facility.  This  attitude  was  exemplified  by 
surveyor  reaction  to  the  OIRR  form.  Surveyors  recognized  the  value  of  the 
information  collected  by  the  in-depth  review  process,  despite  the  additional 
time  demands  Involved,  but  they  were  not  satisfied  with  the  design  and  length  of 
the  OIRR  form.  Thus  while  no  surveyor  Indicated  that  the  OIRR  should  be 
implemented  as  1s,  nearly  two-thirds  suggested  that  the  form  should  be  revised 
and  Implemented,  compared  to  only  about  20  percent  who  favored  elimination  of 
the  form.  HCFA  staff  worked  extensively  with  the  PaCS  surveyor  workgroup  to 
refine  both  the  OIRR  form  and  the  summary  form  to  ensure  that  the  new  forms 
facilitated  a  resident-oriented  approach  without  resulting  1n  an  excessive 
paperwork  burden  for  surveyors. 

Some  resistance  to  changes  in  the  nursing  home  inspection  process  was  to  be 
expected  among  experienced  surveyors,  especially  in  view  of  the  extremely 
flexible  approach  to  assessment  engendered  by  the  traditional  survey  process. 
Surveyor  concerns  were  intensified  by  the  widespread  belief  among  surveyors  (84  . 
percent)  that  they  did  not  receive  adequate  training  prior  to  the  implementation 
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of  the  experimental  process.  Still ,  almost  40  percent  of  the  Interview  group 
felt  that  the  new  process  collected  more  valuable  Information  than  did  the 
traditional  survey,  with  a  similar  proportion  responding  that  the  two  processes 
yielded  information  of  equal  value.  HCFA  believes  that  the  combination  of 
refinements  in  the  survey  process  together  with  a  well-developed,  standardized 
surveyor  training  program  will  produce  increasing  levels  of  surveyor  acceptance 
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CHAPTER  FIVE 

NATIONAL  TESTING  OF  THE  NEW  SURVEY  PROCESS 

Introduction 

The  second  facet  of  HCFA's  two-track  evaluation  effort  involved  the 
limited  national  implementation  of  the  PaCS  process  In  the  47 
non-demonstration  States.  Between  February  1  and  June  30,  1985,  State 
surveyors  conducted  over  350  surveys  in  nursing  homes  with  good 
compliance  histories.  Rehabilitation  Care  Consultants  analyzed  the 
survey  results  and  surveyor  questionnaires  from  this  part  of  the  PaCS 
testing.  Each  HCFA  regional  office  also  monitored  the  implementation  of 
the  new  process  through  the  performance  of  a  limited  number  of  PaCS  and 
traditional  surveys  in  each  State.  This  nationwide  testing  served  both 
to  foster  surveyor  and  facility  familiarity  with  the  new 
resident-oriented  process  as  well  as  to  provide  HCFA  with  broad-based 
feedback  on  the  specific  strengths  and  problems  of  PaCS.  Presented  below 
is  a  discussion  of  the  evaluation  design,  results  and  recommendations 
from  the  RCC  and  regional  office  studies. 

RCC  Study:  Evaluation  Design 

RCC's  evaluation  of  the  PaCS  process  was  by  design  a  primarily 
descriptive  analysis  since,  unlike  in  the  three  demonstration  States,  the 
national  group  of  nursing  homes  surveyed  did  not  represent  a 
scientifically  selected  sample.  RCC  focused  on  how  well  surveyors  were 
implementing  the  formative  PaCS  process  and  made  recommendations 
regarding  elements  of  the  PaCS  survey  forms  and  procedures  that  needed 
clarification  or  modification.  Following  completion  of  its  evaluation  of 
the  PaCS  process,  RCC  was  further  charged  with  developing  draft 
procedural  guidelines  and  training  materials  for  the  conduct  of  PaCS 
surveys,  based  upon  the  conclusions  reached  from  its  review. 

RCC's  analysis  was  based  on  the  following  specific  sources  of  information: 

o   Observational  Surveys — RCC  observed  a  total  of  nine  State  survey 
teams  conducting  the  PaCS  process  in  the  States  of  Colorado, 
Massachusetts,  Missouri,  Illinois  and  Wisconsin.  This  review 
focused  on  the  relative  effectiveness  of  specific  elements  of  the 
process  (e.g.,  the  forms  and  guidelines,  the  mechanisms  for 
detecting  and  documenting  findings  and  then  linking  them  to 
deficiency  citations,  the  appropriateness  of  the  sampling 
methodology,  etc.). 

o   Surveyor  Questionnaires — RCC  reviewed  and  summarized  the  results  of 
approximately  100  PaCS  surveyor  questionnaires  representing  44 
States  1n  order  to  ascertain  the  level  of  surveyor  acceptance  and  to 
Identify  problematic  areas  of  the  PaCS  survey  methodology. 

o    Survey  Report  Forms — RCC  reviewed  all  completed  PaCS  survey  report 
forms,  focusing  on  basically  the  same  sort  of  issues  as  did  the 
observational  surveys.  This  portion  of  the  study  also  required  RCC 
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to  select  stratified*  samples  of  up  to  30  facilities  each  in  order  to 
assess  the  PaCS  process  with  respect  to  variations  in  team  size,  team 
composition,  facility  size  and  facility  type. 

In  addition,  RCC  kept  abreast  of  Brown's  findings  in  the  three  formal 
evaluation  States  and  reviewed  the  evaluation  reports  from  all  previous 
survey  demonstrations  and  experiments  in  formulating  its  findings. 

RCC  Study:  Results 

Results  of  RCC's  nine  observational  surveys  combined  with  its  analysis  of 
surveyor  questionnaires  to  yield  similar  suggestions  as  to  the  main  areas 
that  needed  to  be  addressed  prior  to  full  national  implementation  of  the 
new  survey  process.  These  areas  included: 

Simplifying  the  forms  to  make  them  easier  to  use; 

Developing  more  specific  procedural  guidelines  instructing  surveyors 
in  how  to  apply  the  new  inspection  methodology;  and 

Most  importantly,  greatly  emphasizing  the  quality  and  amount  of 
surveyor  training  in  the  new  process. 

As  detailed  later  in  this  report,  HCFA  has  responded  to  each  of  these 
issues  through  the  use  of  a  surveyor  workgroup  to  refine  the  PaCS  forms 
and  streamline  the  format,  the  development  of  strengthened  procedural 
guidelines  and  the  introduction  of  a  structured  surveyor  training 
program,  respectively. 

On  the  whole,  surveyors  indicated  that  they  liked  the  PaCS  concept  but 
were  not  comfortable  with  the  forms.  Approximately  half  of  the  surveyors 
questioned  reported  that  the  PaCS  process  was  more  effective  than  the 
traditional  survey  (51  percent),  identified  problems  that  may  have  gone 
undetected  (54  percent),  and  enabled  them  to  spend  more  time  observing 
care  provision  and  talking  to  residents  (46  percent).  (The  remaining 
surveyors  either  responded  negatively  or  felt  that  PaCS  had  no  impact 
either  way.)  However,  fully  71  percent  of  the  respondents  indicated  that 
they  had  difficulty  understanding  or  appying  portions  of  the  PaCS  survey, 
particularly  the  tally  sheet,  IORR  form,  ADL  checklist,  and  the  summary 
form.  Reports  of  problems  in  these  areas  were  corroborated  not  only  by 
RCC's  findings  from  its  observational  surveys,  but  also  by  Brown's 
findings  in  the  three-State  formal  evaluation.  Finally,  a  large  majority 
of  the  surveyors  (76  percent)  believed  that  they  had  not  received 
adequate  training  prior  to  PaCS  implementation. 

RCC's  review  of  the  completed  PaCS  survey  reports  also  offered  insights 
Into  several  specific  process-related  issues,  as  well  as  assessing  the 
possible  impact  of  variations  1n  team  size  and  composition  and  facility 
size  and  type  on  the  utility  of  the  PaCS  process.  It  concluded  that  the 
PaCS  forms,  1f  used  correctly,  fostered  a  logical  decision-making  process 
with  appropriate  documentation  to  support  deficiency  citations.  This  was 
In  contrast  to  the  traditional  survey  which  was  considered  not  to  allow  a 
logic  trend  to  be  followed  in  any  retrospective  type  of  review.  However, 
RCC  found  that  surveyors  were  not  generally  using  the  process  correctly, 
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particularly  the  tafly  sheet  and  the  triggering  mechanism.  Noting  that 
the  triggering  mechanism  was  not  producing  anticipated  results,  RCC 
indicated  that  the  process  warranted  further  study  prior  to  national 
implementation.  It  again  stressed  the  need  for  more  extensive  surveyor 
training  and  pinpointed  the  correct  usage  of  forms,  the  formulation  of 
deficiency  statements  and  the  selection  of  a  representative  cross-section 
of  residents  for  in-depth  reviews  as  areas  on  which  surveyor  training 
needed  to  focus . 

The  limited  examination  of  the  impact  of  size  and  composition  and 
facility  size  and  type  on  the  PaCS  process  produced  few  firm  findings. 
For  example,  RCC  identified  few  differences  in  how  surveyors  applied  the 
new  process  or  the  results  they  obtained  in  facilities  of  varying  total 
resident  populations  or  certification  status.  As  represented  in  Table  1 
below,  RCC  did  find  that  many  more  deficiencies  were  cited  in  SNFs  and  in 
dually  certified  facilities  than  in  ICFs. 


Sample  Sizes 
ICF     16 
SNF     30 
ICF/SNF  29 


Table  1 
Deficiencies  by  Certification  Status 


ICF       SNF      ICF/SNF 


Number  of  Total  Deficiencies  for 

All  Surveys  in  Sample  80       365       278 

Average  Number  of  Deficiencies 

Per  Survey  5.0       12.2       9.6 

Number  of  Deficiencies  Oriented 

to  Structure/Paper  55       235       169 

Average  Number  Per  Survey  3.4       7.8       5.8 

Number  of  Deficiencies  Resident 

Centered/Quality  of  Life  24       100       78 

Average  Number  Per  Survey  1.5       3.3      2.7 

Number  of  Deficiencies  Directly 

Threatening  1        36       31 

Average  Number  Per  Survey  0.06       1.2       1.1 

However,  the  same  trend  towards  the  identification  of  a  greater  number  of 
deficiencies  holds  true  for  the  entire  nursing  home  universe,  based  on 
the  results  of  the  most  recent  annual  survey  for  all  homes  as  of  January 
1986: 

ICF       SNF     ICF/SNF 

Average  Number  of  Deficiencies 

Per  Survey  7.8      14.8      14.5 
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(Note  that  the  RCC  data  encompassed  less  than  100  facilities  selected 
based  on  their  good  compliance  histories  while  the  national  data  was 
derived  from  surveys  on  almost  9,000  SNFs  and  7,000  ICFs  of  all  quality 
types. ) 

In  terms  of  survey  team  composition,  RCC's  findings  were  also  generally 
inconclusive,  although  it  did  recommend  the  use  of  multi-disciplinary 
teams  including  at  least  one  RN.  The  area  of  team  composition  was 
thought  to  warrant  further  study.  Another  issue  recommended  for  further 
study  was  that  of  the  effect  of  various  team  sizes  on  the  survey 
process.  However,  as  exhibited  in  Tables  2  and  3  below,  RCC's  data 
indicated  that  teams  comprising  two  to  four  surveyors  tended  to  cite  more 
and  better-documented  deficiencies  than  did  smaller  or  larger  teams. 


Sample  Sizes 

1  Surveyor  30 

2  Surveyors  29 
3-4  Surveyors  27 
5  or  More 

Surveyors  30 


Table  2 
Deficiencies  by  Team  Size 


1        2         3-4      5-more 
Surveyor   Surveyors   Surveyors   Surveyors 


Number  of  Total 

Deficiencies  for  Al 1 

Surveys  in  Sample  183       282       334       237 

Average  Number  of 

Deficiencies  Per  Survey        6.1        9.7      12.0       7.9 


334 

12. 

0 

221 

7. 

.9 

Number  of  Deficiencies 

Oriented  to  Structure/Paper    132       147       221        128 

Average  Number  Per  Survey       4.4       5.1       7.9       4.3 

Number  of  Deficiencies 

Resident  Centered/Quality 

of  Life  15        75       104        112 

Average  Number  Per  Survey      0.5       2.6       3.7       3.7 

Number  of  Deficiencies 

Directly  Threatening         34        57        9         4 

Average  Number  Per  Survey       1.1        2.0       0.3       0.1 
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Table  3 
Defiency  Documentation  by  Team  Size 


Sample  Sizes 

1  Surveyor     30 

2  Surveyors     30 

3-4  Surveyors   29 

5  or  More 

Surveyors     30 

1 

2 

3-4 

5-more 

Surveyor 

Surveyors 

Surveyors 

Surveyors 

Notes  Adequate  to  Support 

Deficiencies  Cited: 

Yes: 

12/28* 

21/30 

19/29 

13/30 

43% 

70% 

66% 

43% 

No: 

16/28* 

9/30 

7/29 

17/30 

57% 

30% 

34% 

57% 

*  Two  surveyors  had  no  deficiencies  cited.  , 

Based  on  this  data  and  other  information  culled  from  review  of  the  State 
modified  survey  projects,  the  procedural  guidelines  for  the  new  survey 
process  recommend  two  to  four  surveyors  as  the  optimum  team  size. 

RCC  Study:   Further  Recommendations 

RCC's  overall  findings  were  highly  supportive  of  the  core  PaCS  process, 
including  the  execution  of  an  in-depth  facility  tour,  the  use  of  targeted 
sampling,  the  intensive  review  of  that  sample  including  observation, 
interview  and  record  review,  increased  emphasis  on  dining  and  eating 
assistance  issues,  the  drug  pass  observation,  and  the  logical 
incorporation  of  survey  findings  into  deficiency  citations  via  the  PaCS 
summary  form.  HCFA  has  addressed  many  of  RCC's  recommendations  (e.g., 
forms  simpl ication,  increased  emphasis  on  training)  in  preparation  for 
implementing  the  new  survey  process.  However,  both  RCC  and  HCFA  share 
the  belief  that  the  new  survey  process  is  still  a  formative  one,  and  one 
that  needs  to  continue  to  evolve  if  it  is  to  fully  achieve  its 
objectives.  As  RCC  stated,  "Concepts  central  to  PaCS... are  the  way  of 
the  future  and  HCFA  should  continue  Its  ongoing  efforts  to  refine  and 
reshape  the  process."  It  offered  the  following  recommendations  for 
future  modifications  to  the  survey  and  certification  process  and  areas  in 
need  of  further  study: 

o    Utilize  the  concept  of  screening  surveys  that  can  trigger  a  more 
Intensive  survey  if  results  warrant. 

o   Conduct  further  studies  on  the  Issues  of  team  size  and  composition. 

o    Improve  the  interface  of  the  survey  system  with  enforcement 
procedures. 

o    Refrain  from  implementing  any  form  of  pre-survey  questionnaire  since 
such  a  vehicle  would  eliminate  any  unpredictability  from  the  timing 
of  the  survey  process. 
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o    Continue  to  seek  and  utilize  surveyor  input  into  the  survey 
modification  process. 

o    Consider  developing  regulations  related  to  care  outcomes. 

o    Pursue  the  integration  of  IoC  and  survey  review  throughout  the 
country. 

A  number  of  these  issues  are  discussed  in  Chapter  Nine  of  this  report, 
which  deals  with  HCFA's  short-  and  long-term  objectives  involving  the  new 
survey  process. 

HCFA  Regional  Study:   Evaluation  Design 

A  much  more  limited  evaluation  of  the  national  testing  of  the  PaCS 
process  was  carried  out  by  the  Division  of  Health  Standards  and  Quality 
of  HCFA's  ten  regional  offices.  From  March  to  July  1985,  each  region  was 
to  conduct  at  least  four  monitoring  surveys  per  State  to  evaluate  the. 
implementation  of  the  PaCS  process  and  the  utilization  of  the  PaCS 
forms.  The  bulk  of  these  surveys  were  strictly  observational,  with  the 
Federal  surveyors  accompanying  their  State  counterparts.  In  addition, 
regional  staff  also  conducted  a  smaller  number  of  comparative  Federal 
monitoring  surveys,  using  both  the  traditional  and  the  PaCS  processes  to 
resurvey  the  same  facilities  subjected  to  PaCS  surveys  by  the  States 
within  a  4-week  period.  This  allowed  surveyors  to  simultaneously  gain 
experience  with  the  new  survey  process  and  to  informally  evaluate 
consistency  between  the  State  PaCS  survey  findings  and  the  findings  of 
PaCS  and  traditional  monitoring  surveys. 

HCFA  Regional  Study:  Results 

The  regional  findings  provided  further  evidence  that  surveyors  were 
uncomfortable  with  the  PaCS  forms  and  generally  found  them  cumbersome  to 
use.  This  was  particularly  true  of  the  OIRR  form  and  the  tally  sheet. 
Surveyor  concern  over  the  adequacy  of  the  training  program  was  also 
reiterated.  They  specifically  cited  the  need  for  expanded  procedural 
guidelines  in  order  to  clarify  perceived  problem  areas  such  as  the 
triggering  procedures  and  the  decision  as  to  what  constitutes  a 
deficiency.  On  the  positive  side,  regional  surveyors  were  enthusiastic 
about  the  drug  pass  and  the  fact  that  the  PaCS  process  focused  on 
resident  care  and  outcomes.  They  agreed  that  the  resident-centered 
approach  allowed  the  surveyor  to  comprehensively  follow  a  specific 
resident  and  to  observe  the  total  care  pattern,  thereby  promoting  the 
identification  of  systemic  resident  care  problems. 

Table  4  and  5  below  present  summarized  comparisons  of  State  and  Federal 
findings  from  44  surveys.  Table  4  contains  the  results  of  State  and 
Federal  PaCS  surveys  in  22  facilities.  Table  5  compares  the  findings 
from  State  PaCS  surveys  with  traditional  Federal  surveys  In  another  group 
of  22  facilities. 
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Table  4 
Deficiency  Totals:  PaCS  vs.  PaCS 


Patient  Rights 
Physicians  Services 
Nursing  Services 
Dietetic  Services 
Pharmacy 

Patient  Activities 
Infection  Control 
Social  Services 
Rehab.  Services 


States 
PaCS  Survey 

18 
10 
79 
39 

9 

13 
33 

4 

0 


Federal 
PaCS  Survey 

16 
24 
76 
41 
10 
17 
18 

3 

4 


Total  Patient  Care  Deficiencies  205 


209 


Physical  Environment 
Other 

49 
24 

36 
22 

Total  Deficiencies 

: 

278 

267 

1  of  Patient  Care  Def 

iciencies 

73.7% 

78.2% 

Defi 

iciency  Total 
States 

Table  5 
s:  PaCS  vs. 

,  Tradi 

i  tional 

Federal 

PaCS  Survey 

Traditional 

Surve 

Ly. 

PaCS 
Taqs 

PaCS 
Taqs 

Structural 
Taqs 

R0 
Total 

Patient  Rights 
Physicians  Services 
Nursing  Services 
Dietetic  Services 
Pharmacy 

Patient  Activities 
Infection  Control 
Social  Services 
Rehab.  Services 

19 
23 
84 
29 
5 
9 

16 
7 
5 

7 
28 
58 
10 

3 
14 

0 
13 

2 

56 

22 

88 

54 

34 

8 

29 

0 

1 

63 
50 
146 
64 
37 
22 
29 
13 
3 

Total  Patient  Care 
Deficiencies: 

197 

135 

292 

427 

Physical  Environment 
Other 

35 
28 

39 
108 

Total  Deficiencies: 

260 

574 

1  of  Patient  Care 
Deficiencies 

75.81 

74.41 
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Analysis  of  Table 
deficiencies  was  v 
sets  of  surveyors 
the  areas  of  nursi 
comparison  of  the 
indicated  that  the 
overall  deficienci 
cited  under  the  tr 
with  the  State  sur 
care  deficiencies 
physical  environme 
scientifically  sel 
this  survey  compar 
the  States  and  reg 
of  participation  a 


4  reveals  that  the  total  number  of  patient  care 

ery  similar  in  State  and  Federal  PaCS  surveys.  Both 

identified  more  than  50  percent  of  all  deficiencies  in 

ng  services  and  dietetic  services.  Table  5's 

State  PaCS  surveys  with  the  traditional  Federal  surveys 

regional  surveyors  were  citing  considerably  more 
es.  However,  more  than  two-thirds  of  the  deficiencies 
aditional  method  can  be  classified  as  structural  items, 
veyors  actually  identifying  a  greater  number  of  direct 
than  the  Federal  surveyors  and  a  comparable  number  of 
nt  deficiencies.  These  results  were  not  based  on  a 
ected  sample,  and  no  severity  analysis  is  available  for 
ison.  Further  analysis  did  reveal  that  in  no  case  did 
ions  disagree  in  terms  of  citing  a  regulatory  condition 
s  out  of  compl iance. 
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CHAPTER  SIX 
THE  NEW  LONG-TERM  CARE  SURVEY  PROCESS 


Introduction 

Beginning  in  April  1986,  HCFA  will  mandate  the  use  of  a  new  methodology  for 
surveying  nursing  homes  that  is  intended  to  focus  the  inspection  process  more 
directly  on  the  actual  care  provided  to  residents.  The  new  onsite  process  and 
survey  reporting  forms  are  designed  to  incorporate  preferred  components  of  the 
modified  survey  approaches  tested  in  various  States  since  1978,  as  well  as 
adopting  portions  of  other  approaches  that  stress  the  delivery  and  outcomes  of 
resident  care.  As  this  report  has  detailed,  the  new  survey  process  has  been 
subjected  to  an  extensive  testing,  evaluation  and  refinement  effort  since  its 
introduction  in  December  1983.  This  section  of  the  report  explains  how  the 
new  survey  process  will  work  and  highlights  several  of  its  most  innovative 
features. 

Overview:  Smith  v.  Heckler  Case 

The  primary  purpose  of  the  new  long-term  care  survey  process  is  to  better 
assess  whether  high  quality  care  is  actually  being  furnished  to  Federal 
beneficiaries  in  the  nation's  nursing  homes.  Although  the  onsite  inspection 
methodology  has  been  modified  considerably,  nursing  homes  are  still  required 
to  be  in  continuous  compliance  with  all  current  regulations  in  order  to  be 
certified.  The  regulations  setting  forth  the  quality  assurance  requirements 
for  SNFs  (42  CFR  Part  405,  Subpart  K)  and  ICFs  (42  CFR  Part  442,  Subpart  F) 
have  not  been  changed.  The  only  regulatory  changes  involved  in  implementing 
the  new  process  are  minor  modifications  to  two  sections  of  the  regulatory  code 
dealing  with  certification  procedures  (42  CFR  405.1906  and  42  CFR  442.30). 
The  effect  of  the  changes  is  to  explicitly  require  State  survey  agencies  to 
use  the  survey  methods,  procedures  and  forms  prescribed  by  HCFA  in  its  current 
general  instructions. 

The  impetus  for  introducing  the  new  survey  process  via  a  regulatory  change  was 
a  court  order  from  the  United  States  District  Court  in  Colorado  stemming  from 
The  Estate  of  Smith  v.  Heckler  case.  This  order  was  the  result  of  a  suit 
filed  in  1975  on  behalf  of  residents  in  a  Colorado  nursing  home  in  which 
plaintiffs  claimed  that  HHS  had  failed  to  carry  out  its  duty  to  ensure  that 
Medicaid  patients  in  nursing  homes  were  actually  receiving  high  quality  care. 
After  extended  judicial  proceedings,  HHS  eventually  responded  that  it  had 
developed  a  revised  survey  system  that  would  enable  HHS  to  better  determine 
the  actual  quality  of  care  provided.  The  court  then  ordered  the  Department  to 
develop  and  publish  a  Notice  of  Proposed  Rulemaking  (NPRM)  regarding  the  new 
survey  process.  In  response  to  the  court  order,  HHS  published  an  NPRM 
(Federal  Register,  Vol.  50,  No.  211,  October  31,  1985,  pg.  45584)  describing 
its  intent  to  implement  a  new  outcome-oriented  survey  process  in  1986  and 
setting  forth  regulatory  language  mandating  State  use  of  HCFA's  survey  forms 
and  procedures.  As  in  the  past,  the  forms  and  procedures  themselves  were  not 
set  forth  in  regulations.  However,  copies  of  the  new  forms,  methodology  and 
guidelines  were  made  available  to  all  interested  parties  during  the  NPRM 
process.  In  November  1985,  plaintiffs  in  the  Smith  v.  Heckler  case  requested 
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that  the  court  enjoin  the  rulemaking  process,  instruct  HHS  to  publish  another 
NPRM  containing  all  new  survey  forms,  methods  and  procedures,  and  extend  the 
period  for  public  comment  on  this  information  until  at  least  60  days  after  the 
publication  of  the  Institute  of  Medicine's  study  on  the  survey  process.  On 
December  27,  the  court  announced  its  decision  not  to  interfere  with  the 
rulemaking  process  and  denied  the  plaintiff's  motion  to  enjoin. 

This  effectively  cleared  the  way  for  HCFA  to  implement  the  new  survey  process 
as  planned  in  April  1986.  Under  the  new  methodology,  a  complete  long-term 
care  facility  survey  essentially  will  consist  of  three  components— a  review  of 
administrative  and  procedural  requirements  (Part  A),  a  review  of  requirements 
directly  impacting  resident  care  (Part  B),  and  the  traditional  review  of  Life 
Safety  Code  requirements.  Parts  A  and  B  are  embodied  in  the  new  two-part 
survey  forms,  HCFA-525  and  HCFA-519,  which  replace  the  HCFA  1569  and  HCFA  3070 
forms  in  both  SNFs  and  ICFs. 

Part  A  of  the  New  Survey  Process 

Part  A  of  the  new  survey  process  consists  of  a  review  of  the  organizational 
and  procedural  requirements  specified  under  all  current  Conditions  of 
Participation.  The  Part  A  form  includes  requirements  for  both  SNFs  and  ICFs 
in  the  following  areas: 

o  written  administrative  and  resident  care  policies 

o  bylaws  and  other  organizational  documentation 

o  written  agreements  with  outside  resources/consultants 

o  committee  meeting  and  reporting  requirements 

o  staff  qualifications  and  written  development  programs 

o  other  written  programs,  plans  or  systems  (e.g.  equipment 
maintenance,  disaster  preparedness) 

Unlike  the  traditional  survey  forms,  Part  A  does  not  provide  a  verbatim 
presentation  of  each  regulatory  condition,  standard  and  element.  Instead,  it 
sometimes  restates  the  essential  nature  of  each  administrative  and  procedural 
requirement  and  references  the  appropriate  regulatory  citation  for  SNFS  and/or 
ICFs  as  applicable. 

Use  of  Part  A 

Surveyors  will  conduct  an  onsite  evaluation  of  the  Part  A  requirements  only 
for  initial  surveys.  Facilities  not  meeting  these  requirements  will  not  be 
certified  for  participation.  Part  A  will  not  be  applied  for  resurveys  of 
participating  LTC  facilities.  At  the  time  of  resurvey,  a  facility  would  be 
required  to  attest  in  writing  that  there  have  been  no  administrative  or 
procedural  changes  that  would  affect  Part  A  compliance  and  that  1t  agrees  to 
notify  the  State  agency  immediately  of  any  changes  in  its  organization  or 
management  which  may  raise  questions  regarding  continuing  compliance.  The 
State  agency  will  then  determine,  through  a  Part  B  survey,  whether  such 
changes  have  had  an  adverse  effect  on  the  qualify  of  resident  care.  If  the 
quality  of  care  has  been  adversely  affected,  the  State  agency  may  verify 
compliance  with  the  requirements  contained  in  Part  A. 
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Part  B  of  the  New  Survey  Process 

Part  B  of  the  new  survey  is  the  refined  version  of  the  resident-oriented 
process  that  has  been  known  heretofore  as  PaCS.  All  SNFs  and  ICFs  will 
receive  a  Part  B  survey  on  an  annual  basis.  The  Part  B  process  and  forms 
concentrate  on  the  areas  of  the  traditional  survey  that  are  directly  related 
to  resident  care  (nursing  services,  physician  services,  dietary  services, 
resident  activities,  etc.).  The  new  approach  stresses  resident  outcomes  and 
the  actual  provision  of  care  and  services.  Surveyors  will  cite  deficiencies 
directly  from  the  review  of  resident  care  and  treatment  rather  than  from  a 
review  of  policies  and  procedures. 

The  Part  B  survey  is  designed  to  provide  a  more  valid  and  reliable  assessment 
of  the  quality  of  care  furnished  by  a  nursing  home.  By  bringing  surveyors 
face  to  face  with  a  representative  sample  of  residents,  it  enables  surveyors 
to  more  accurately  identify  resident  needs  and  problems  and,  subsequently,  to 
determine  how  well  care  is  being  provided  to  meet  those  needs.  In  addition, 
by  requiring  surveyors  to  follow  specific  procedures  and  to  perform  resident 
review  using  a  specified  checklist,  Part  B  promotes  greater  consistency  in 
methodology  and  findings  than  has  been  achieved  under  the  traditional 
process.  Consider  the  following  examples: 

o    In  the  traditional  process,  surveyors  could  evaluate  a  facility's 

policies  and  procedures  to  ascertain  that  grooming  and  personal  hygiene 
rules  were  designed  to  satisfy  resident  needs.  Under  the  new  process, 
surveyors  must  determine  whether  these  needs  are  actually  satisfied. 
This  requires  the  surveyor  to  observe  residents  and  to  note  that  they  are 
in  fact  clean  and  well  groomed.  Information  provided  by  the  residents 
can  also  be  used  to  determine  whether  such  needs  are  regularly  met. 

o    In  the  traditional  process,  surveyors  could  review  a  sample  of  medical 
records  to  determine  if  restorative  nursing  procedures  were  performed 
daily  and  recorded.  The  new  process  requires  surveyors  to  speak  with 
residents  about  the  frequency  of  the  care  and  treatments  received,  in 
addition  to  observing  and  documenting  the  frequency  of  care  for 
comparison  with  the  medical  record. 

o    In  the  traditional  process,  surveyors  could  review  a  facility's  policies 
and  procedures  to  ensure  that  there  was  a  written  disaster  preparedness 
plan.  Under  the  new  process,  surveyors  are  instructed  to  question 
facility  staff  regarding  their  awareness  of  such  a  plan  and  their 
individual  responsibilities  towards  the  residents. 

As  can  be  seen  in  the  examples  above,  the  new  survey  process  embodies  many  of 
the  preferred  techniques  now  used  by  surveyors  in  conducting  the  traditional 
process.  Under  the  new  process,  however,  a_M  surveyors  will  be  expected  to 
employ  such  techniques.  In  addition,  a  major  innovation  of  the  Part  B  survey 
1s  the  requirement  that  surveyors  complete  worksheets  evaluating  a  sample  of 
residents  In  the  areas  of  general  care,  nutrition  and  medication 
administration.  An  evaluation  of  these  areas,  along  with  an  In-depth  tour  of 
the  facility  that  also  Includes  a  structured  worksheet,  form  the  four  major 
activities  of  the  new  survey  process. 
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Entrance  Conference  - 

As  always,  before  proceeding  with  the  care  review  aspects  of  the  survey, 
surveyors  hold  an  entrance  conference  to  introduce  themselves  to  facility 
staff  and  explain  the  basic  steps  of  the  survey  process.  Other  activities 
that  surveyors  take  care  of  at  the  entrance  conference  include: 

Requesting  that  the  facility  complete  the  Resident  Census  portion  of  the 
HCFA-51 9  as  soon  as  possible  so  that  the  information  can  be  used  in  the 
subsequent  survey  process; 

Asking  the  facility  to  post  a  notice  that  the  surveyors  are  in  the 
facility  and  available  to  meet  with  residents;  and 

Making  arrangements  to  meet  with  representatives  of  the  facility's 
resident  council,  if  applicable. 

Resident-Centered  In-depth  Tour 

Following  the  entrance  conference,  the  first  major  component  of  a 
Part  B  survey  is  an  in-depth  facility  tour  designed  to  assess  the  general 
state  of  the  facility  and  its  residents  and  to  identify  potential  problems. 
Part  B  procedural  guidelines  stress  that  the  tour  should  focus  on  the 
resident's  needs  and  whether  or  not  those  needs  are  being  met.  The  tour 
should  accomplish  three  specific  purposes: 

o    First,  the  tour  is  used  to  scan  each  resident  in  terms  of  individual 

needs.  This  will  require  the  surveyor  to  spend  approximately  3  hours  in 
the  tour  activity  for  every  100  residents.  The  scanning  process 
evaluates  care  for  numerous  items  including  grooming  and  hygiene, 
positioning,  interaction  with  staff,  restraints,  and  respect  for 
residents'  rights.  The  surveyor  notes  resident-specific  problems  as  well 
as  patterns  of  care  that  demand  further  investigation. 

o    Second,  the  tour  is  used  to  identify  residents  for  in-depth  reviews. 
Generally,  residents  selected  for  in-depth  review  should  be 
representative  of  the  facility  population,  exhibit  a  variety  of  care 
needs,  and  include  those  exhibiting  potentially  poor  outcomes.  The 
sample  should  consist  of  heavy  care  and  light  care  residents.  Both  of 
these  groups  should  Include  residents  who  are  alert,  confused  and  those 
unable  to  communicate.  Procedural  guidelines  Instruct  surveyors  to 
utilize  the  resident  census  data  provided  by  the  facility  to  assist  in 
choosing  a  representative  resident  sample. 

o    Finally,  the  tour  is  used  to  evaluate  the  physical  environment  of  the 
facility.  Each  resident's  room  1s  evaluated  1n  addition  to  common 
resident  areas.  Issues  of  health  and  safety,  Infection  control  and 
personal  expression  are  evaluated.  Additionally,  other  structural 
concerns  such  as  staff  awareness  of  disaster  procedures  are  covered. 

In  addition  to  scanning  Individual  residents,  the  tour  should  also  focus  on 
assessing  the  residents  as  a  group  in  order  to  detect  overall  patterns  and 
trends  of  care.  Pertinent  findings  about  care  patterns  and  resident 
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condition,  along  with  resident  identification  information,  should  be  noted  by 
the  surveyor  on  the  Tour  Notes  Worksheet  (Exhibit  1).  This  information 
assists  the  surveyor  in  selecting  a  resident  sample  and  in  focusing  attention 
on  possible  problem  areas. 

Observation/Interview/Record  Review  of  Sample  Residents 

After  selecting  residents  for  in-depth  review,  surveyors  evaluate  the  physical 
condition  of  each  sample  resident  according  to  a  prescribed  observable 
criteria  set  (see  Exhibit  2,  OIRR  Worksheet).  The  purpose  of  the  in-depth 
review  of  a  sample  of  residents  is  to  determine  if  the  facility  is 
consistently  meeting  the  needs  of  residents.  While  making  these  observations, 
surveyors  conduct  brief  interviews  with  the  resident  and/or  staff  in  order  to 
gain  additional  information  about  the  resident's  condition  and  facility  care 
patterns.  Interviews  should  last  approximately  15  minutes  depending  on  the 
needs  and  wishes  of  the  resident.  Surveyors  also  note  the  behavior  and  level 
of  awareness  of  confused  residents  and  those  unable  to  communicate  in  order  to 
reconcile  resident  needs  with  the  plan  of  care  in  the  record.  Documentation 
of  resident  interview  data  is  in  accordance  with  the  surveyor's  need  to 
specifically  recall  information  for  survey  findings.  Staff  interviews  should 
focus  on  methods  and  frequency  of  care  provision  and  other  pertinent  issues 
related  to  the  care  of  each  sampled  resident.  The  surveyor  should  note 
whether  applicable  care  processes  or  interventions  (e.g.,  decubitus  care)  are 
being  appropriately  provided.  Suggested  interview  questions  as  well  as 
definitions  of  appropriate  care  and  interventions  are  provided  in  guidelines. 

Following  the  observation/interview,  surveyors  review  the  medical  record  of 
each  sample  resident.  Surveyors  may  choose  to  perform  an  expanded  record 
review  to  verify  suspected  problem  patterns  of  care.  Each  record  should 
demonstrate  that  the  facility  has  adequately  assessed  all  the  resident's 
problems  and  needs,  developed  a  plan  of  care,  provided  care  accordingly,  and 
evaluated  the  effectiveness  of  care. 

After  each  in-depth  resident  review,  the  surveyor  should  summarize  the 
findings  on  the  OIRR  worksheet,  highlighting  problematic  areas.  The  summary 
process  ensures  that  all  essential  information  is  readily  available  to  be 
transferred  to  the  survey  report  form  and  cues  the  surveyor  to  be  alert  for 
similar  types  of  problems  in  other  residents.  Once  all  OIRR  worksheets  are 
completed,  the  surveyor  reviews  the  summarized  findings  for  evidence  of  poor 
care  patterns  and  transfers  the  appropriate  information  to  the  survey  report 
form. 

Drug  Pass  Observation 

The  new  survey  process  incorporates  a  major  advance  in  the  technique  used  by 
surveyors  to  evaluate  a  facility's  medication  administration  practices. 
Rather  than  depending  on  a  review  of  nursing  notes  or  medication 
administration  records  to  detect  drug  administration  errors,  the  new  "drug 
pass"  methodology  requires  surveyors  to  observe  the  actual  provision  of  drugs 
to  residents.  As  part  of  the  drug  pass  observation,  surveyors  note  the  drugs 
as  they  are  poured  for  each  resident,  observe  the  actual  administration  of 
each  drug  and  then  check  drug  orders  to  determine  whether  the  pour  and  the 
administration  are  done  as  prescribed.  This  methodology  ensures  that  survey 
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findings  on  medication  administration  are  definitive  and  cannot  be  dismissed 
as  documentation  errors.  Surveyors  are  instructed  to  conduct  a  drug  pass 
observation  on  approximately  20  randomly  selected  residents  per  facility  and 
to  record  individual  findings  on  the  Drug  Pass  Worksheet  (see  Exhibit  3).  Any 
patterns  or  problems  discerned  from  worksheet  results  are  transferred  to  the 
survey  report  form  under  the  appropriate  rule. 

Dining  and  Eating  Assistance  Observation 

The  fourth  major  component  of  the  new  survey  process  is  the  focused  evaluation 
of  meals,  dining  areas  and  eating  assistance.  Mealtimes  offer  surveyors  a 
concentrated  opportunity  to  observe  how  well  a  facility  meets  a  primary  need 
of  a  significant  number  of  residents.  Since  not  all  residents  eat  in  the 
dining  room  though,  a  surveyor  should  also  devote  attention  to  the  provision 
of  meals  in  other  locations  such  as  resident  rooms.  By  observing  how 
residents  are  being  fed,  how  much  help  they  need  and  receive,  and  how  much 
food  they  eat,  in  conjunction  with  determining  if  meals  agree  with  diet 
orders,  a  surveyor  determines  whether  the  facility  is  actually  providing 
proper  nourishment.  The  dining  observation  also  provides  information  on  a 
wide  variety  of  nondietary  issues  such  as  staff  interaction  with  residents, 
promptness  and  appropriateness  of  assistance,  availability  and  use  of  adapti 
equipment,  appropriateness  of  dress  and  hygiene  for  meals,  etc. 


ve 


Surveyors  use  the  Dining  Assistance  Worksheet  (Exhibit  4)  to  record 
observations  in  this  area,  and  two  meals  are  generally  observed.  At  each 
meal,  surveyors  are  instructed  to  select  a  minimum  of  five  residents  for  a 
comparison  of  meals  served  with  the  diet  card  and  physician  orders.  A 
facility  is  also  evaluated  for  how  well  it  assesses,  plans  and  provides  for 
the  nutritional  and  eating  assistance  needs  of  residents  during  the  surveyor's 
indepth  review  of  the  ten  percent  resident  sample.  Findings  from  both  the 
dining  assistance  worksheet  and  the  in-depth  resident  review  can  contribute  to 
appropriate  areas  of  the  survey  report  form. 

Conclusion  of  a  Part  B  Survey 

Once  the  four  major  tasks  of  the  Part  B  process  have  been  completed,  a  survey 
team  should  identify  patterns  and  areas  where  a  facility  appears  to  have 
difficulty  in  addressing  problems  and  providing  care.  Surveyors  must  then 
formulate  deficiency  statements  based  on  the  severity  and/or  frequency  of 
identified  care  problems.  Although  deficiency  statements  continue  to  depend 
to  a  large  extent  on  subjective  professional  judgment,  the  new  process  ensures 
that  each  deficiency  stems  from  resident-specific  examples  that  are  indicative 
of  a  breakdown  in  a  facility's  care  delivery  system.  At  the  traditional  exit 
conference  concluding  a  Part  B  survey,  a  survey  team  should  be  able  to  provide 
specific  examples  of  how  a  facility's  deficiencies  are  impacting  upon  the 
quality  of  life  for  its  residents. 

Problem  Correction  and  Follow-Up 

Under  the  new  survey  process,  surveyors  are  charged  with  the  identification  of 
care  problems,  rather  than  the  responsibility  for  ascertaining  the  reasons  for 
these  problems  (e.g.,  inadequate  policies  and  procedures  or  inefficient 
organizational  structure).  A  facility  is  expected  to  review  its  own  care 
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delivery  system  to  locate  root  causes  for  poor  resident  care.  Following  such 
review,  a  facility  will  be  required  to  submit  a  plan  of  correction  that 
identifies  necessary  changes  to  assure  deficiency  correction.  A  plan  of 
correction  should  address  the  system  level  problems  that  may  have  resulted  in 
a  resident-specific  problem  or  negative  care  outcome.  Plans  of  correction 
specific  to  residents  identified  as  examples  of  improper  or  inadequate  care 
are  not  acceptable. 

Follow-up  surveys  also  differ  from  those  conducted  under  the  traditional 
process.  Surveyors  re-evaluate  specific  care  provided  to  residents  which  was 
identified  as  deficient.  If  care  problems  continue  to  exist,  the  surveyor 
must  assume  that  the  facility's  appraisal  of  its  service  delivery  breakdown  or 
the  implementation  of  its  plan  for  correction  was  insufficient.  At  this 
point,  further  action  on  the  certification  status  of  facilities  which  remain 
non-compliant  will  follow  traditional  procedures. 

Life  Safety  Code  Survey 

As  in  the  past,  the  Life  Safety  Code  portion  of  the  survey  is  performed  on  an 
onsite  basis  in  every  facility.  Implementation  of  the  new  survey  process  will 
not  affect  the  nature  or  requirements  of  a  Life  Safety  Code  survey.  The  Life 
Safety  Code  surveyor  will  continue  to  apply  the  particular  edition  of  the  code 
applicable  to  each  facility,  either  in  conjunction  with  or  separate  from  the 
revised  activities  of  other  surveyors. 
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CHAPTER  SEVEN 
CONSUMER,  INDUSTRY,  AND  STATE  INVOLVEMENT 


Introduction 


Arguably  the  single  most  important  ingredient  in  achieving  the 
implementation  of  the  new  long-term  care  survey  process  has  been  the 
continuing  cooperation  among  all  of  the  primary  parties  in  the  nursing 
home  regulatory  system.  As  discussed  in  the  background  section  of  this 
report,  HCFA  laid  the  groundwork  for  a  revised  survey  during  the  1983 
task  force  sessions  of  Federal,  State,  industry  and  consumer 
representatives  to  identify  areas  of  consensus  for  changes  in  the  survey 
and  certification  process  and  regulations  (Subpart  S).  One  issue  on 
which  all  the  groups  could  agree  was  the  inherent  shortcomings  of  the 
traditional  survey  process  and  the  need  to  develop  and  test  improved 
survey  procedures  and  forms.  Throughout  the  PaCS  developmental  and 
testing  process,  HCFA  has  maintained  ongoing  contact  with  representatives 
of  the  consumer  advocates,  the  nursing  home  industry  and  the  State  survey 
agencies  in  order  to  obtain  their  input  and  support  in  our  efforts  to 
refine  the  new  long-term  care  survey.  Each  of  these  groups  was 
represented  at  the  initial  surveyor  training  sessions  on  the  new 
methodology,  and  HCFA  hopes  to  continue  drawing  on  their  expertise  and 
resources  as  the  new  survey  process  evolves. 

Consumer  Advocate  Role 

The  National  Citizens'  Coalition  for  Nursing  Home  Reform  (NCCNHR),  the 
National  Council  for  Senior  Citizens  (NCSC),  and  the  American  Association 
of  Retired  Persons  (AARP)  all  took  part  in  the  Subpart  S  workgroup 
sessions  of  1983.  Since  that  time,  HCFA  has  kept  these  organizations 
apprised  of  progress  towards  a  revised  survey  process  and  has  worked 
particularly  closely  with  NCCNHR  on  some  of  the  specific  details  of  the 
new  methodology. 

NCCNHR  is  designed  to  coordinate  the  activities  of  nearly  200  consumer 
advocacy  groups  including  a  national  network  of  State  and  local  long-term 
care  ombudsman  programs.  The  Coalition  works  to  ensure  that  nursing  home 
residents  receive  quality  care  and  are  represented  in  the  regulatory 
process.  During  the  Subpart  S  workgroup  sessions,  one  of  NCCNHR's 
primary  concerns  was  that  the  proposed  changes  in  the  long-term  care 
survey  procedures  did  not  take  into  consideration  the  information  and 
personal  experiences  available  from  nursing  home  residents.  In  an  effort 
to  facilitate  increased  resident  participation  in  the  survey  process, 
HCFA  agreed  to  provide  partial  funding  for  a  project  to  collect  and 
analyze  information  from  residents  across  the  country  about  the  quality 
of  care  and  life  in  nursing  homes.  This  project,  which  was  funded 
primarily  by  the  AARP,  culminated  in  a  National  Symposium  on  Quality  Care 
1n  February  1985. 

The  symposium  provided  a  forum  to  present  the  composjte  findings  of 
NCCNHR's  resident  discussions.  Although  public  policy  was  the  least 
discussed  Issue  among  residents,  they  felt  strongly  that  they  should  have 
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direct  input  into  the  nursing  home  inspection  process.  HCFA  and  the 
other  parties  involved  in  the  regulatory  system  have  come  to  recognize 
the  fundamental  fairness  of  this  assertion,  and  mandatory  resident 
interviews  are  an  integral  element  of  the  new  survey  methodology. 

In  addition  to  propounding  the  need  for  resident  participation  in  the 
survey  process,  the  NCCNHR  project  also  provided  HCFA  with  guidance  as  to 
the  type  of  questions  that  surveyors  should  ask  residents  about  the 
delivery  of  care  and  services  and  suggested  techniques  to  be  used  in 
questioning  the  resident  population.  Much  of  this  information  was 
incorporated  into  the  procedural  guidelines  developed  for  use  with  the 
new  survey  process. 

Since  NCCNHR  issued  the  final  report  on  its  residents'  perspective 
project  in  April  1985,  HCFA  staff  have  continued  to  meet  regularly  with 
Coalition  representatives  (e.g.,  on  May  16,  August  15,  September  6, 
October  10)  to  discuss  the  many  issues  involved  in  the  refinement  and 
implementation  of  the  new  long-term  care  survey  process.  Other  consumer 
organizations,  particularly  the  National  Senior  Citizen's  Law  Center  and 
the  aforementioned  NCSC  have  also  played  a  role  in  these  discussions. 
The  September  6,  1985  panel  session  on  the  proposed  survey  process,  which 
took  place  in  the  larger  context  of  NCCNHR's  ninth  annual  meeting, 
provided  a  good  example  of  the  cooperation  that  has  characterized  the 
PaCS  developmental  process.  This  meeting  brought  together 
representatives  from  the  consumer  advocacy  groups,  the  nursing  home 
industry  and  the  State  agencies  to  be  briefed  by  HCFA  and  to  present 
their  respective  concerns. 

Although  the  consumer  advocate  groups  have  generally  been  very  supportive 
of  the  new  survey  methodology,  they  have  expressed  concern  over  the 
adequacy  of  the  surveyor  training  program,  especially  in  view  of  the 
initiation  of  required  resident  interviewing.  In  what  constituted  a  true 
landmark  in  Federal /consumer  cooperation,  NCCNHR  agreed  to  develop  a 
script  and  enlist  actual  nursing  home  residents  as  role  players  for  a 
video  tape  instructing  surveyors  on  interviewing  skills  and  techniques. 
In  addition  to  the  strengthened  surveyor  training  program,  HCFA  has 
adopted  several  of  NCCNHR's  suggestions  for  inclusion  in  new  procedural 
guidelines,  including  the  recommendations  that  surveyors  routinely  obtain 
input  from  a  facility's  resident  council  and  that  surveyors  post  notice 
and  wear  identification  to  indicate  that  an  inspection  is  being 
conducted.  Other  NCCNHR  suggestions,  such  as  required  State  agency 
contact  with  local  ombudsman  groups  and  resident  participation  in  exit 
interviews,  remain  under  consideration. 

Following  publication  in  the  Federal  Register  of  the  proposed  regulation 
implementing  the  new  survey  process  on  October  31,  1985,  HCFA  undertook  a 
major  mailing  effort  at  the  request  of  NCCNHR  to  ensure  that  affected 
groups  were  made  aware  of  and  had  an  opportunity  to  comment  on  the 
impending  change.  Over  400  packages,  containing  the  new  survey  forms, 
procedural  guidelines  and  other  informational  materials,  were  distributed 
to  NCCNHR's  member  groups  and  State  ombudsman  programs.  NCCNHR  then 
convened  a  work  session  on  December  9-11,  J985,  attended  by 
representatives  of  all  the  major  consumer  groups  and  ombudsman  programs, 
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to  develop  a  response  to  HCFA's  formal  proposal  to  implement  the  modified 
survey  process.  Federal  and  State  regulators,  nursing  home  industry 
representatives  and  legal  service  professionals  specializing  in  consumer 
Issues  also  contributed  their  views.  Most  of  the  organizations 
represented  at  this  meeting  submitted  formal  comments  to  HCFA  as  part  of 
the  rulemaking  process.  A  brief  analysis  of  comments  concludes  this 
chapter. 

Nursing  Home  Industry  Role 

Like  the  consumer  advocate  groups,  organizations  representing  the 
nation's  nursing  home  industry  have  made  continuing  contributions  to  the 
PaCS  refinement  process  since  its  introduction  at  the  Subpart  S  workgroup 
sessions  late  in  1983.  Among  the  organizations  that  have  taken  part  in 
this  effort  are  the  American  Health  Care  Association  (AHCA),  the  American 
College  of  Health  Care  Administrators  (ACHCA),  and  the  National  Council 
of  Health  Centers  (now  merged  with  AHCA).  HCFA  has  also  received  direct 
input  on  the  new  survey  process  from  representatives  of  facility  chains 
(e.g.,  Beverly  Enterprises,  Manor  Health  Care  Operation),  State  and  local 
provider  organizations  and  individual  facilities. 

Shortly  after  the  first  pilot  testing  of  the  PaCS  survey  process  began  in 
December  1983,  AHCA  distributed  copies  of  the  earliest  version  of  the 
modified  survey  forms  to  a  large  number  of  its  members.  AHCA  reported  to 
HCFA  in  February  1984  that  its  members  found  the  new  format  to  be  an 
improvement  on  the  traditional  process,  but  also  had  an  extensive  list  of 
specific  suggestions  for  improving  the  forms.   In  June  1984,  AAHA 
reported  that  its  membership  had  a  similarly  favorable  reaction  to  the 
new  survey  process.  Like  their  AHCA  counterparts,  the  AAHA  members  made 
numerous  suggestions  about  additional  language  or  clarifications  that 
could  be  included  in  the  survey  form  in  addition  to  some  more  general 
concerns.  For  example,  both  groups  felt  that  the  word  "resident"  rather 
than  "patient"  should  be  used  throughout  the  forms  and  guidelines,  and 
they  also  expressed  concern  over  a  perceived  trend  towards  negative 
wording  (i.e.,  "patient  is  not  groomed  properly,"  "eating  utensils  are 
not  available")  in  the  PaCS  Indicators  and  interview  questions.  HCFA 
made  substantial  use  of  these  types  of  recommendations  in  developing  the 
subsequent  versions  of  the  new  long-term  care  survey. 

As  HCFA  began  preparing  for  national  testing  of  the  modified  process,  the 
industry  groups  continued  to  play  an  active  role.  AHCA  representatives 
attended  a  PACS  surveyor  training  session  in  December  1984  to  increase 
their  understanding  of  how  the  new  process  was  to  be  applied.  ACHA  then 
requested  a  meeting  with  HCFA  staff  to  discuss  several  areas  of  concern 
about  the  modified  survey  process,  including: 

o    Tone  -  AHCA  felt  that  parts  of  the  PaCS  survey  forms,  particularly 
the  sections  on  physical  environment  and  dining  assistance,  were 
still  worded  negatively  and  needed  to  be  reformulated  in  a  more 
neutral  tone. 
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o    Resident  Interviews  -  AHCA  estimated  that,  based  on  the  questions 
included  in  the  survey  forms,  resident  interviews  could  run  as  long 
as  30  minutes  and  include  inappropriate  areas  of  questioning  for 
some  residents. 

o    Norms  and  Standards  -  AHCA  expressed  concern  that  the  new  process 
would  perpetuate  the  subjective  nature  of  current  compliance 
decisions  unless  standards  and  norms  were  established  prior  to 
implementation  to  define  operational  compliance. 

HSQB  staff  met  with  an  AHCA  representative  on  January  29,  1985,  to 
address  these  issues.  They  agreed  to  make  the  necessary  further  changes 
in  the  forms  to  assure  neutrality  in  tone  and  indicated  that  the 
procedural  guidelines  had  already  been  amended  to  include  more 
specificity  regarding  the  length  and  nature  of  resident  interviews,  based 
on  similar  suggestions  from  HCFA's  Office  of  Management  and  Budget. 
Regarding  the  need  to  establish  norms  and  standards,  the  HSQB  staff 
pointed  out  that  one  of  the  major  assets  of  the  new  survey  process  is 
that  it  defines  a  minimal  data  set  that  surveyors  are  required  to  cover 
during  each  survey.  Once  the  new  methodology  is  fully  implemented,  HCFA 
intends  to  gather  baseline  data  in  order  to  identify  norms  and  standards 
for  compliance  decisions. 

At  a  May  3  meeting  of  the  AHCA  Standards  Committee,  consisting  primarily 
of  representatives  of  nursing  home  chains,  the  group  reiterated  to  HCFA 
staff  its  support  of  PaCS  and  acknowledged  HCFA's  responsiveness  in 
removing  negative  language  from  the  survey  form.  HCFA  then  contributed 
an  article  to  the  AHCA  Journal  (Vol.  11,  No.  4,  July  1985)  discussing  the 
objectives  and  features  of  the  new  process  and  tentative  plans  for 
implementation.  During  August  and  September  1985,  HCFA  staff  met  twice 
with  ACHCA,  the  leading  facility  administrator  organization,  to  keep  them 
informed  on  progress  towards  implementing  the  new  survey  process.  ACHCA 
was  also  supportive  and  requested  a  similar  article  on  the  new 
methodology  for  its  own  publication,  which  HCFA  has  submitted  for 
inclusion  in  the  ACHCA's  spring  1986  issue.  Another  facet  of  the 
industry  organizations'  ongoing  involvement  has  been  their  participation 
In  NCCNHR  forums  such  as  the  September  6,  1985  panel  session  and  the 
December  9-11  workgroups  on  the  proposed  survey  process.  Both  national 
organizations  such  as  the  AHCA,  AAHA  and  ACHCA,  as  well  as  State  and 
local  industry  groups,  have  been  represented  at  these  meetings. 

The  result  of  HCFA's  continuing  contact  with  the  nursing  home  industry 
has  been  a  new  survey  methodology  that  is  better  understood  and  better 
accepted  than  any  previous  attempt  to  revise  the  Inspection  system.  As 
AHCA  stated  in  its  November  15  newsletter: 

"Providers  who  have  been  surveyed  under  PaCS  have  been  Impressed 
with  the  new  process.  They  have  reported  that  patient  Interviews 
have  not  been  lengthy,  that  patient  privacy  has  been  respected  and 
that  staff  members  have  enjoyed  their  role  In  demonstrating 
quality.  Repeatedly,  providers  have  said  that  PaCS  does  focus  the 
survey  process  on  quality."  (AHCA  Notes,  Vol.  14,  No.  21, .Nov.  15, 
1985,  pg.  5) 
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AHCA's  impressions  were  corroborated  by  Brown  University's  findings  from 
its  questionnaire  on  the  reactions  of  nursing  home  administrators.  HCFA 
will  be  soliciting  provider  input  as  the  new  long-term  care  survey 
implementation  and  evaluation  process  unfolds.  An  initial  indication  of 
this  commitment  to  continuing  consensus  building  was  found  in  the  first 
surveyor  training  sessions  for  the  new  methodology,  which  brought 
together  Federal,  State,  consumer  and  industry  representatives  to 
experience  the  new  training  program. 

Role  of  the  State  Agencies 

In  terms  of  immediate  impact,  the  people  that  are  most  affected  by  the 
change  to  a  new  survey  methodology  are  the  State  agency  surveyors  charged 
with  carrying  out  the  new  methodology.  With  this  in  mind,  HCFA  formed  a 
PaCS  advisory  committee  to  discuss  issues  related  to  the  implementation, 
evaluation  and  refinement  of  the  new  survey  process.  This  committee, 
which  has  been  meeting  on  a  regular  basis  since  September  1984,  consists 
of  HCFA  staff  and  representatives  from  the  Association  of  Health  Facility 
Licensure  and  Certification  Directors  (AHFLCD)  and  from  the  three  State 
survey  agencies  involved  in  the  formal  evaluation  of  the  PaCS  process. 
Dr.  William  Spector,  who  headed  up  the  Brown  University  evaluation 
effort,  also  attended  the  early  meetings  of  the  committee  and  submitted 
interim  reports  for  review  once  the  evaluation  was  underway. 

The  first  meeting  of  the  advisory  committee  took  place  on  September  13, 
1984.  Representatives  from  Connecticut,  Rhode  Island,  and  Tennessee 
confirmed  that  the  States  would  participate  in  the  formal  testing 
process,  and  surveyor  training  sessions  were  scheduled  for  October  1984. 
Following  a  discussion  of  the  PaCS  pilot  testing  process  and  the  planned 
1985  implementation  and  evaluation  strategy  in  those  three  States,  the 
AHFLCD  reported  a  concern  among  its  members  that  the  PaCS  process  would 
be  implemented  without  modification  after  the  test  was  completed.  HCFA 
responded  that  such  a  prospect  was  extremely  unlikely  in  view  of  the  wide 
range  of  consultant,  consumer,  industry  and  State  input  that  would  be 
forthcoming  during  1985.  Participants  then  agreed  that  they  would  meet 
regularly  throughout  the  1985  testing  year,  and  HCFA  intends  to  continue 
drawing  on  the  AHFLCD  as  a  source  of  State  reactions  and  suggestions  as 
the  new  survey  process  is  implemented  nationally  in  1986. 

Subsequent  meetings  of  the  advisory  committee  were  held  on  December  12, 
1984,  and  on  April  2,  July  12,  and  October  23,  1985.  The  first  of  these 
concentrated  on  the  implementation  activities  of  the  three  formal  testing 
States  and  a  discussion  of  the  testing  and  evaluation  strategy  for  the 
remainder  of  the  country.  The  1985  sessions  of  the  committee  normally 
consisted  of  updates  on  Brown's  testing  progress  and  available  results, 
comments  from  Rhode  Island,  Connecticut  and  Tennessee,  a  national  update 
on  Implementation  status  and  findings  In  the  other  47  States,  and  then  a 
report  on  HCFA's  activities  and  timeframes  relating  to  PaCS  revisions  and 
plans  for  full  national  Implementation.  As  an  outgrowth  of  these 
meetings,  HCFA  also  convened  a  PaCS  form  workshop  to  gather  further 
feedback  from  State  and  Federal  surveyors  on  problems  encountered  In 
using  the  new  methodology  and  recommendation  for  forms  modi fi cations. 
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The  purpose  of  the  surveyor  workgroup  was  to  evaluate  the  design  and 
content  of  the  PaCS  survey  report  forms  and  to  devise  a  more  workable 
product.  Participants  in  the  three-day  (June  17-19,  1985)  workgroup 
session  included  experienced  PaCS  surveyors  from  nine  States  and  two 
ROs.  Following  a  brief  report  on  the  results  of  Brown's  questionnaire  on 
surveyor  acceptance  of  the  new  survey  process  and  forms,  the  group  was 
encouraged  to  focus  its  review  and  recommendation  on  the  more  problematic 
forms . 

The  surveyor  workgroup  demonstrated  a  surprising  degree  of  consensus  as 
to  needed  revisions  in  the  PaCS  forms.  The  group  recommended  that  the 
forms  covering  pharmacy  record  review  and  suggested  interview  questions 
be  placed  in  guidelines  and  that  the  tally  sheet  be  deleted  altogether. 
They  also  suggested  major  format  revisions  to  the  summary  form  and  the 
observation/interview/record  review  form.  These  recommendations,  which 
were  generally  1n  concert  with  those  developed  by  RCC  through  its 
evaluation  of  the  PaCS  process,  were  adopted  in  the  revised  version  of 
the  long-term  care  survey  Instrument. 

Although  the  State  survey  agencies  were  proving  to  have  substantial  input 
into  the  final  composition  of  the  new  survey  methodology,  AHFLCD  still 
had  some  serious  reservations  about  HCFA's  transition  plans.  In  an 
August  7  letter  to  the  Director  of  HSQB,  AHFLCD  expressed  its  belief  that 
the  new  survey  process  was  superior  to  the  traditional  survey  but  that 
the  planned  January  1 986  implementation  would  not  permit  adequate  time  to 
incorporate  evaluation  findings  and  to  properly  train  surveyors. 

HCFA  subsequently  postponed  implementation  until  April  1986  and  held  a 
series  of  surveyor  training  courses  in  the  revised  methodology  from 
February  through  April  of  1986.  As  detailed  in  the  next  section  of  this 
report,  HCFA  also  provided  each  State  with  the  materials  necessary  to 
train  surveyors  who  could  not  be  accommodated  at  the  first  set  of  Federal 
training  sessions.  Implementation  of  the  new  process  will  be 
accomplished  on  a  phased-1n  basis,  and  no  surveyor  will  be  expected  to 
conduct  the  new  survey  without  prior  training. 

Public  Comment 

HCFA  received  approximately  75  letters  of  comment  in  response  to  its  NPRM 
Introducing  the  new  survey  process  for  nursing  homes.  These  letters  came 
from  a  multiplicity  of  sources  Including  most  of  the  national  consumer 
and  provider  groups  mentioned  above,  State  survey  agencies  and 
departments  on  aging,  professional  organizations,  local  ombudsmen  and 
resident  advocacy  groups,  as  well  as  individual  providers,  nursing  home 
residents  and  other  concerned  citizens.  The  comments  reflected 
widespread  overall  support  for  HCFA's  efforts  to  refocus  the  survey 
process  on  the  review  of  Individual  resident  care. 

At  the  same  time,  the  majority  of  commentors  offered  strong  and  often 
conflicting  suggestions  as  to  how  the  new  survey  process  (and  the  entire 
long-term  care  regulatory  system)  could  be  further  revised  to  better 
assess  and  ensure  quality  of  care  1n  nursing  homes.  .Among  the  Issues 
drawing  particular  attention  were  the  following: 
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Implementation  schedule 

Need  to  incorporate  IoM  study  results 

Training  program 

Procedural  and  care  guidelines 

Resident  sample  selection  methodology 

Confidentiality  of  resident  interviews 

Need  for  ombudsman  involvement  in  survey  process 

Deficiency  formulation  criteria  (i.e.,  need  for  norms  and  standards) 

Use  of  Part  A  of  the  new  process 

Survey  team  composition 

Increased  duplication  between  survey  and  IoC  reviews  (and  the  need 

to  integrate  the  processes) 

These  comments  have  been  reviewed  by  HCFA  staff,  and  specific  responses 
are  now  under  formulation.  The  final  rule  will  include  a  detailed 
description  of  comments  and  HCFA's  responses.  In  general,  HCFA  believes 
that  the  new  survey  process  already  constitutes  a  significant  improvement 
over  its  predecessor  and  is  ready  for  implementation.  As  Chapter  Nine  of 
this  report  describes,  HCFA  is  committed  to  the  continuing  refinement  of 
the  new  methodology,  with  revisions  expected  as  early  as  October  1986. 
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CHAPTER  EIGHT 
SURVEYOR  TRAINING  IN  THE  NEW  PROCESS 


Introduction 

A  recurring  theme  among  the  diverse  list  of  organizations  and  individuals 
who  have  contributed  to  the  development  of  the  new  survey  methodology  has 
been  the  overriding  importance  of  the  surveyor  training  program.  HCFA 
recognizes  that  the  success  of  the  new  process  depends  in  large  measure 
on  how  well  surveyors  understand  the  revised  approach  and  how 
consistently  they  employ  its  forms  and  techniques.  With  this  in  mind, 
HCFA  has  developed  a  3-day  program  to  educate  surveyors  in  the  new 
process.  The  specific  objectives  of  the  training  program  are  threefold: 

o    Provide  surveyors  with  an  understanding  of  the  philosophical  intent 
and  the  developmental  background  of  the  new  resident-oriented  survey 
process; 

o    Provide  instructions  and  the  opportunity  for  hands-on  experience  in 
the  use  of  the  new  survey  report  form  and  accompanying  worksheets; 
and 

o    Instruct  surveyors  in  the  resident  interviewing  and  observation 
techniques  that  are  the  focus  of  the  new  approach. 

Training  Schedule 

HCFA  is  initially  conducting  six  training  sessions  on  the  new  long-term 
care  (LTC)  survey  process,  with  approximately  50  Federal  and/or  State 
surveyors  in  attendance  at  each  session.  Representatives  of  consumer  and 
industry  groups  that  have  been  involved  in  the  formation  of  the  process 
also  participated  in  the  initial  training  session  held  in  Baltimore  from 
February  11-13,  1986.  Subsequent  sessions  were  scheduled  as  follows: 

Baltimore,  Maryland  February  25-27 

San  Diego,  California  March  4-6 

Albany,  New  York  March  11-13 

Chicago,  Illinois  March  18-20 

Denver,  Colorado  March  25-27 

Participants  in  the  sessions  include  LTC  surveyors  of  all  disciplines  as 
well  as  Individuals  from  the  States  and  regional  offices  responsible  for 
the  supervision  and  training  of  surveyors.  Course  faculty  consist  of 
Federal  and  State  personnel  who  have  taken  part  1n  the  testing  and 
refinement  of  the  new  forms  and  procedures,  along  with  consultants  to 
HCFA  who  are  regularly  involved  in  surveyor  training. 

Training  Agenda 

The  new  LTC  survey  training  course  1s  designed  to  be  a  participatory 
program.  Each  surveyor  has  an  opportunity  to  simulate  a 
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resident-centered  survey  in  a  controlled  environment  through  the  use  of 
audio-visual  aids.  The  course  includes  presentations  on  the  following 
specific  areas: 

Background  information  on  the  new  process 

LTC  Survey  Report  Forms 

LTC  survey  guidelines 

Facility  tour 

OIRR  worksheet 

Drug  pass  observation  worksheet 

Dining  and  eating  assistance  worksheet 

Formulation  of  deficiency  statements 

Resident  observation  and  interviewing  skills 

Each  of  the  new  data  collection  worksheets  1s  covered  in  detail  and  used 
frequently.  Instructors  place  special  attention  on  the  skills 
development  portion  of  the  training,  emphasizing  the  importance  of 
surveyor  sensitivity  to  the  rights  and  needs  of  residents. 

Training  Materials 

The  training  program  for  the  new  survey  process  makes  extensive  use  of 
audio-visual  aids.  These  training  materials  serve  not  only  to  promote 
the  increased  effectiveness  of  the  HCFA-run  training  sessions,  but  also 
to  assure  that  training  conducted  in  the  individual  States  can 
Incorporate  a  consistent  approach  to  the  new  process.  A  brief 
description  of  each  of  the  training  aids  that  HCFA  has  commissioned  is 
provided  below: 

o    Introductory  Video  -  Media  Communications  developed  a  videotape  to 
introduce  the  new  LTC  survey  process.  The  tape  includes  a  brief 
introduction  to  the  Medicare/Medicaid  program,  the  intent  of  the 
regulations  and  their  impact  on  residents  and  the  nursing  home 
Industry. 

o    Slide/Tape  Presentation  -  Rehabilitation  Care  Consultants,  Inc. 

(RCC)  produced  an  integrated  slide/tape  presentation  that  provides 
an  overview  of  the  new  LTC  survey  process  and  portrays  a  tour  of  a 
facility  depicting  significant  survey  functions  and  form  usage. 

o   Slide/Case  Study  Exercise  -  RCC  also  produced  40  slides  covering 
typical  nursing  home  problems  In  resident  care,  physical 
environment,  eating  assistance  and  nutrition.  The  slides  are 
presented  In  conjunction  with  three  short  exercises  demonstrating 
the  use  of  the  Facility  Tour,  Dining  and  Eating  Assistance  and  Drug 
Pass  worksheets.  The  slides  are  also  Integrated  with  a  case  study 
made  up  of  Information  from  two  sample  residents  1n  order  to 
demonstrate  how  to  use  the  OIRR  worksheet  and  to  translate  findings 
onto  the  Survey  Report  Form. 

o   Skills  Development  Tape  -  The  National  Citizens  Coalition  for 

Nursing  Home  Reform  provided  HCFA  with  a  script  and  actual  residents 
to  serve  as  role  players  for  a  video  tape  on  Interviewing.  The  tape 
focuses  on  Increasing  surveyor  sensitivity  to  the  rights,  needs,  and 
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dignity  of  nursing  home  resident,  in  conjunction  with  the  Implementation 
of  required  residents  Interviewing  as  part  of  the  new  survey  process. 

o    Course  Manuals  -  HCFA  developed  a  training  manual  Incorporating  all 
the  written  materials  necessary  to  accompany  the  audio-visual 
training  aids  described  above,  including: 

orientation  material 
survey  report  forms 
procedural  guidelines 
care  gui del ines 
case  study  materials 

Extended  Training 

Since  the  Intlal  training  sessions  can  accommodate  only  about  300  of  the 
approximately  2,000  LTC  facility  surveyors,  HCFA  needed  to  find  a  way  to 
rapidly  orient  the  remaining  surveyors  so  that  the  new  methodology  can  be 
nationally  implemented  on  a  timely  basis.  Resource  and  time  constraints 
preclude  the  immediate  retraining  of  all  surveyors  through  central  office 
run  training  sessions.  Instead,  HCFA  has  developed  a  self-contained 
training  module  based  on  the  audio-visual  materials  used  at  the  initial 
training  sessions.  Regional  and  State  surveyors  who  attend  the  HCFA-run 
training  are  using  these  materials,  in  conjunction  with  the  training 
course  manuals,  to  familiarize  all  surveyors  in  their  respective  areas 
with  the  new  process.  Over  500  of  the  manuals  are  being  made  available 
to  all  the  HCFA  regional  offices  and  the  State  survey  agencies  for 
further  duplication  and  distribution  to  each  nursing  home  surveyor. 

In  one  sense,  development  of  a  new  survey  process  represented  an  attempt 
to  formally  embody  the  preferred  techniques  (e.g.,  emphasizing  individual 
resident  observations,  resident  and  staff  interviewing)  that  have  always 
been  used  by  many  surveyors.  The  phased-in  implementation  process  that 
is  about  to  begin  will  assure  that  aJM  surveyors  will  be  using  these 
techniques  in  the  field  as  soon  as  possible,  thus  providing  Immediate 
practical  reinforcement  In  the  use  of  the  new  process.  This  Is  In  line 
with  RCC's  recommendation  that  there  be  a  minimal  time  lag  between 
surveyor  training  and  actual  implementation.  HCFA  will  also  provide 
follow-up  training  in  late  1986  and  early  1987  in  order  to  maintain 
consistency  1n  the  application  of  the  new  survey  process.  Specific  areas 
to  be  stressed  will  be  Identified  through  Brown  University's  evaluation 
of  sample  surveys  during  1986,  an  Internal  evaluation  of  the  initial 
training  process  and  the  continuing  use  of  surveyor  questionnaires  on  the 
new  process. 
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CHAPTER  NINE 
FUTURE  PLANS:   THE  EVOLUTION  OF  THE  SURVEY  PROCESS 


Introduction 

The  new  long-term  care  survey  process  to  be  introduced  by  HCFA  in  April 
1986  represents  the  first  major  substantive  change  in  the  method  used  to 
assess  nursing  homes  since  the  inception  of  facility  surveys  in  the  late 
1960's.  Although  national  implementation  of  the  new  survey  process  is  a 
meaningful  milestone  in  Federal  quality  assurance,  it  is  by  no  means 
viewed  as  an  cure-all.  Rather,  the  new  survey  methodology  constitutes 
the  beginning  of  an  evolving  process  of  assuring  that  nursing  home 
surveys  employ  state-of-the-art  techniques  for  assessing  the  actual 
quality  and  outcomes  of  care  provided  to  facility  residents. 

Beyond  this,  HCFA  recognizes  that  the  survey  process  does  not  take  place 
in  a  vacuum,  but  needs  to  be  considered  in  the  larger  context  of  the 
entire  Federal  quality  assurance,  enforcement  and  even  reimbursement 
role.  The  new  process  has  been  designed  to  accommodate  and  complement 
several  anticipated  initiatives  springing  from  recommendations  of  the 
Institute  of  Medicine's  (IoM)  Study  of  Nursing  Home  Regulation  as  well  as 
the  possible  future  implementation  of  a  national  prospective  payment 
system  for  nursing  home  reimbursement.  The  concluding  section  of  the 
report  outlines  HCFA's  short-  and  long-term  plans  for  the  continuing 
evaluation  and  refinement  of  the  survey  process  and  how  the  evolving 
process  fits  into  the  overall  regulatory  system. 

Short-Term  Agenda 

In  order  to  assure  that  the  survey  process  continues  to  evolve  as 
planned,  HCFA  plans  to  conduct  ongoing  reappraisals  of  the  new  process 
and  then  to  initiate  appropriate  changes  at  pre-determined  intervals. 
The  beginning  of  FY  1987  (October  1986)  marks  the  first  such  interval. 

As  part  of  this  effort,  HCFA  is  already  involved  In  several  initiatives 
to  refine  the  new  survey  methodology  and/or  the  accompanying  guidelines. 
A  brief  description  of  each  of  these  initiatives,  all  of  which  are  now  in 
the  developmental  stages,  is  presented  below: 

o    Revised  Care  Guidelines — During  the  rulemaking  process  used  to 
introduce  the  new  survey  process,  representatives  of  both  the 
consumer  advocacy  groups  and  the  nursing  home  industry  organizations 
expressed  a  willingness  to  assist  HCFA  1n  further  refining  the  care 
guidelines  used  by  surveyors  to  assess  the  quality  of  care  provided 
for  a  specific  problem  or  condition  (e.g.,  contractures,  decubiti, 
etc.).  HCFA  will  utilize  health  professionals,  drawn  from  the 
Federal,  consumer  and  Industry  sectors  and  working  1n  a  group 
format,  to  make  suggestions  for  refinements  1n  the  current 
guidelines  1n  time  for  October  1986  implementation. 
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o    Resident  Sample  Selection  Methodology — Although  the  evaluations  of 
the  alternative  State  survey  methodologies  cited  the  need  to  select 
a  resident  sample  that  targeted  potential  problem  areas,  comments  on 
the  NPRM  evidenced  some  concern  that  such  targeting  might  give  a 
distorted  view  of  a  facility's  care  provision  performance.  In 
response  to  such  comments,  HCFA  made  a  number  of  changes  to  its 
-procedural  guidelines  to  emphasize  how  surveyors  can  be  sure  to 
select  a  representative  sample  of  residents  for  in-depth  review. 
Additionally,  HCFA  staff  are  now  in  the  process  of  developing  a  more 
detailed  sample  selection  methodology  that  will  explicitly  instruct 
surveyors  in  the  selection  of  targeted  residents  within 
random-stratified  categories.  This  process  is  also  anticipated  for 
implementation  by  October  1986. 

o    Ombudsman  Involvement  in  the  Survey  Process — In  conjunction  with 
requiring  resident  interviews  and  resident  council  input  into  the 
survey  process  for  the  first  time,  HCFA  also  recognizes  the 
contribution  that  local  resident  advocacy  groups,  particularly 
ombudsman  programs,  can  make  to  the  survey  process.  HCFA  will 
convene  a  forum  of  its  own  central  and  regional  office  staff,  State 
personnel,  and  representatives  of  the  NCCNHR  and  its  regional/local 
member  organizations  to  identify  model  sites  for  review  of  current 
notification,  consultation,  and  information  sharing  practices. 
Based  on  this  review,  HCFA  plans  to  issue  an  advisory  policy  by 
October  1986  on  State  agency  linkage  with  regional  and  local 
ombudsman  groups  and/or  other  resident  advocates. 

o    Survey  Team  Size  and  Composition  Study — HCFA  is  currently  collecting 
data  regarding  size  and  composition  (including  qualifications)  of 
survey  teams  as  they  vary  across  States.  This  data  will  be  compared 
with  State  deficiency  findings  in  a  effort  to  develop  parameters  for 
what  constitutes  a  "model"  survey  team  for  each  provider  type.  HCFA 
plans  to  work  with  State  survey  agency  representatives  in  developing 
the  model  team  recommendations.  The  long-range  possibility  exists 
that  States  may  be  funded  at  levels  based  on  such  staff  support 
needs. 

In  addition  to  these  activities,  several  forces  are,  or  will  be,  at  work 
that  may  result  in  further  changes  to  the  new  survey  process  as  early  as 
October  1986.  Foremost  among  such  forces  is  the  IoM  study,  the  results 
of  which  are  expected  to  be  available  by  March  1986.  Although  the  study 
is  directed  primarily  at  long-range  policy  alternatives  for  nursing  home 
quality  assurance,  HCFA  will  begin  to  Implement  acceptable 
recommendations  as  soon  as  feasible.  In  fact,  preliminary  indications 
are  that  both  the  involvement  of  ombudsman  groups  and  the  use  of 
stratified  random  sampling  in  surveys  will  be  among  the  IoM 
recommendations  that  can  be  accomplished  on  a  short-term  basis.  Other 
sources  of  information  that  can  contribute  to  the  Initial  refinement  of 
the  new  survey  process  include  the  final  results  of  Brown  University's 
evaluation  of  the  formal  PaCS  testing,  the  Federal  monitoring  survey 
results  from  the  first  quarter  performance  of  the  new  survey  (covering 
April  -  June  1986),  as  well  as  State  and  regional  surveyor  Input  on  both 
the  new  training  program  and  the  effectiveness  and  ease  of  Implementation 
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of  the  new  process  as  used  in  FY  1986.  These  sources  are  also  expected 
to  be  used  by  HCFA  to  Identify  areas  to  focus  on  during  the  second  round 
of  training  sessions  slated  to  begin  in  the  fall  of  1986. 

Long-Term  Agenda 

As  mentioned,  the  IoM  study  is  expected  to  be  a  significant  source  of 
recommendations  that  can  be  used  to  help  set  long-term  goals  for  the 
refinement  of  the  survey  process  and  the  overall  nursing  home  regulatory 
system.  During  1986,  HCFA  will  prepare  a  comprehensive  response  to  the 
IoM  proposals  delineating  how  HCFA  plans  to  address  specific  study 
recommendations.  The  majority  of  HCFA's  long-term  agenda,  however,  will 
be  determined  by  the  results  of  a  series  of  studies  aimed  at  refining  the 
new  survey  process  and  investigating  its  potential  for  providing 
individual  resident  assessment  information.  These  studies  include: 

1.   Effectiveness  of  New  Long-Term  Care  Survey  Process — HCFA's  Health 
Standards  and  Quality  Bureau  has  awarded  a  2-year  contract  (January 
1986  to  December  1987)  to  the  Long-Term  Care  Gerontology  Center  at 
Brown  University  to  extend  its  evaluation  of  the  new  survey 
process.  This  contract  will  study  and  report  on  the  following: 

o    Use  of  Norms  and  Standards  for  Deficiency  Citation — Through  an 
in-depth  analysis  of  all  data  from  its  three-State  formal 
evaluation,  Brown  will  examine  the  relationship  between  numbers 
and  types  of  negative  findings  and  deficiency  citations.  This 
analysis  will  be  presented  to  the  State  Survey  Directors  in  six 
New  England  States  (HCFA's  Region  I)  in  order  for  them  to 
develop  a  consensus  on  what  are  appropriate  criteria  for 
deficiency  citations.  Once  a  consensus  has  been  achieved,  the 
next  step  will  be  a  trial  implementation  of  the  standards  in 
Region  I,  leading  to  eventual  national  introduction  of  norms 
and  standards  for  what  constitutes  a  deficiency. 

o    Effective  Use  of  New  Procedures  by  Surveyors — Brown  University 
personnel  will  observe  a  sample  of  surveys  in  five  States  (New 
York,  South  Carolina,  Missouri,  Wisconsin,  California)  during 
1986  to  determine  how  consistently  surveyors  are  implementing 
the  new  methodology,  to  identify  specific  difficulties 
surveyors  may  be  experiencing,  and  to  collect  information  on 
how  much  time  is  involved  and  how  time  is  allocated  under  the 
new  process.  This  portion  of  the  study  will  result  in 
recommended  refinements  to  both  the  survey  process  and  the 
surveyor  training  program  and  provide  baseline  time  data  for 
future  comparison. 

o    Effectiveness  of  Enforcement  Mechanisms  Following  the  New 

Survey  Process —  Using  the  same  five  States  as  testing  sites, 
Brown  personnel  will  conduct  site  visits  to  a  sample  of 
facilities  after  State  surveyor  follow-up  visits.  They  will 
make  Independent  determinations  as  to  whether  deficiency 
correction  plans  have  been  met  and  whether  surveyors  have 
properly  documented  any  lack  of  correction.  Brown  will  also 
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perform  a  qualitative  review  of  each  State's  enforcement  mechanisms  and  a 
quantitative  review  of  the  number  and  type  of  enforcement  actions  taken. 
This  portion  of  the  study  should  produce  strengthened  Federal  guidelines 
on  follow-up  and  enforcement  activities. 

2.  Longitudinal  Study  of  Case-Mix  Outcomes  and  Resource  Use  in  Nursing 
Homes — Under  the  direction  of  HCFA's  Office  of  Research  and 
Demonstrations,  Brown  University  is  conducting  a  separate  3-year 
study  (October  1985  -  September  1988)  to  identify  relationships 
between  resource  use  and  resident  outcomes  over  time.  The  project 
involves  first  the  development  of  case-mix  subgroups  for  nursing 
home  residents,  the  tracking  of  outcome  patterns  for  these  subgroups 
and  finally  the  formulation  of  appropriate  resource  use  patterns  for 
the  case-mix  categories.  In  terms  of  the  survey  process,  findings 
from  this  study  can  provide  standards  for  surveyors  to  determine  if 
sufficient  staffing  and  other  resources  are  available  to  care  for 
the  specific  needs  of  residents  in  each  facility.  The  project  also 
has  major  implications  for  linking  HCFA's  quality  assurance  and 
reimbursement  mechanisms. 

3.  New  York  State  Survey/IoC  and  Reimbursement  Demonstration — ORD  is 
now  strongly  considering  approving  a  New  York  proposal  for  a  3-year 
demonstration  (beginning  in  November  1986)  linking  the  new  survey 
process.  New  York's  Sentinel  Health  Event  IoC  system  and  its  new 
case-mix  reimbursement  system.  The  New  York  system  will  provide  a 
working  laboratory  for  examining  how  a  prospective  reimbursement 
system  in  nursing  homes  will  impact  on  quality  of  care,  as  measured 
by  the  new  survey  process  and  an  integrated  IoC  review.  The 
proposed  system  will  also  be  the  first  test  of  the  use  of  a 
pre-selected  random  stratified  resident  sample  and  of  an  early 
warning  system  to  target  facilities  for  unannounced  off-cycle 
surveys  that  have  high  incidences  of  poor  outcomes  and/or  too  few 
staff. 

4.  Multi-State  Demonstration  Integrating  Case-Mix  Reimbursement  and 
Nursing  Home  Quality  Assurance  Systems — ORD  is  now  in  the  process  of 
organizing  a  5-State,  5-year  study  (tentatively  beginning  in 
December  1986)  to  examine  whether  data  obtained  through  a  case-mix 
reimbursement  system  can  be  used  to  monitor  individual  resident  care 
and  the  overall  quality  of  care  of  individual  nursing  homes.  Such 
data  would  also  be  used  to  test  the  desirability  of  a  targeted 
approach  to  long-term  care  survey  and  certification  activities, 
I.e.,  focusing  monitoring  activities  on  certain  providers  and  thus 
reducing  overall  nursing  home  surveillance  costs.  While  New  York 
would  be  among  the  five  States,  the  demonstration  would  need  to  take 
place  1n  a  sufficient  number  of  States  to  assure  the  applicability 
of  findings  despite  extensive  inter-State  variations  In  the  nursing 
home  Industry. 

New  Directions 

Even  a  cursory  review  of  these  studies  reveals  a  .significant  new 
direction  for  the  survey  process  towards  the  collection  of  resident 
specific  data  to  supplement  the  traditional  facility  deficiency  data. 
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During  the  1985  formal  PaCS  demonstration,  It  will  be  recalled  that 
surveyors  in  Rhode  Island  were  required  to  calculate  ADL  assessments  for 
all  sample  residents  and  to  record  all  resident  assessment  Information 
via  the  use  of  portable  computers.  These  procedures,  although  not 
Imminent  for  national  application,  represent  the  wave  of  the  future  in 
long-term  care  surveying.  HCFA  envisions  that  surveyors  will  eventually 
input  both  facility-specific  and  resident-specific  data  directly  into  its 
automated  data  system. 

The  collection  of  individual  resident  assessment  information  on  a  sample 
basis  is  a  precursor  to  a  long-awaited  change  in  the  nursing  home  quality 
assurance  system — the  integration  of  the  survey  and  IoC  processes  on  a 
national  basis.  Over  the  past  several  years,  the  many  advantages  of 
survey/IoC  integration  have  been  repeatedly  documented  in  both  internal 
HCFA  studies  as  well  as  a  series  of  studies  such  as  the  Mathematica  and 
RCC  reports  and  individual  State  assessments.  The  forthcoming  IoM  report 
will  also  strongly  support  integration.  Since  the  new  survey  process 
essentially  follows  an  IoC  review  approach  to  the  resident  sample,  even 
more  duplication  between  survey  and  IoC  review  will  take  place.  If 
resident-specific  sampling  based  on  outcome  measures  continues  to  prove 
viable  and  effective,  both  Congress  and  individual  States  are  likely  to 
recognize  that  the  new  survey  process  negates  the  need  for  the 
prohibitively  time  consuming  IoC  review  of  100  percent  of  facility 
residents. 

Finally,  if  the  advent  of  resident  specific  assessments  can  faci 1 itate 
the  transition  to  an  integrated  survey/IoC  review  system,  such 
assessments  are  an  absolute  prerequisite  to  HCFA's  plans  to  propose  a 
prospective  payment  reimbursement  system  for  nursing  homes,  as  required 
by  Congress  under  the  Tax  Equity  and  Financial  Responsibility  Act  of  1982 
(P.L.  97-248).  The  new  survey  process,  with  its  increased  emphasis  on 
in-depth  resident  assessment  and  its  potential  for  providing  outcome  and 
resource  utilization  data,  looms  as  the  logical  vehicle  for  collection  of 
the  data  that  will  be  essential  to  assuring  that  nursing  home  quality  of 
care  does  not  suffer  under  a  prospective  reimbursement  system. 
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